VoiceCraft-X
The facts below are what the maker publishes about VoiceCraft-X, checked and dated. Our editors have not written about it yet.
The facts
Each one read from VoiceCraft-X's own pages, with the date it was checked.
What it does
- Authorship
- The repository credits Zhisheng Zheng and the University of Texas at Austin with copyright in 2025.checked 13 Oct 2026
- Availability
- The repository's listed inference examples are speech editing and speech synthesis Jupyter notebooks.checked 13 Oct 2026
- Checkpoints
- The repository links to a default multilingual checkpoint and English and Chinese monolingual checkpoints, with more languages noted as forthcoming.checked 13 Oct 2026
- Code switching
- The site includes Chinese-English code-switching samples and says Spanish-English and French-English samples are coming soon.checked 12 Oct 2026
- Code-switching
- The site shows Chinese-English code-switching samples and says Spanish-English and French-English samples are coming soon.checked 13 Oct 2026
- Commercial use
- Nochecked 20 Sep 2026
- Consent
- The repository says speech generation or editing should not be performed using someone's speech without that person's consent.checked 13 Oct 2026
- Development status
- The repository lists environment setup, inference code, additional monolingual checkpoints, hosted demos, Colab notebooks, command-line support, and efficiency improvements as TODO items.checked 13 Oct 2026
- Fine-tuning
- A code-switching sample table includes a VoiceCraft-X (10h fine-tuning) column.checked 12 Oct 2026
- Input and training
- The system overview caption says the model takes text and a speaker embedding as input and is trained to predict speech-token sequences.checked 12 Oct 2026
- Languages
- The site lists English, Mandarin, Korean, Japanese, Spanish, French, German, Dutch, Italian, Portuguese, and Polish.checked 13 Oct 2026
- License
- The work is licensed under Creative Commons Attribution-NonCommercial 4.0 International, and the repository says to contact the authors for commercial use.checked 13 Oct 2026
- Model architecture
- The site says VoiceCraft-X uses the Qwen3 large language model for phoneme-free cross-lingual text processing.checked 12 Oct 2026
- Product
- VoiceCraft-X is an autoregressive neural codec language model for multilingual speech editing and zero-shot text-to-speech synthesis.checked 12 Oct 2026
- Purpose
- VoiceCraft-X combines multilingual speech editing with zero-shot text-to-speech synthesis in one autoregressive neural codec language model.checked 13 Oct 2026
- Setup
- The repository installation instructions create a Python 3.10 Conda environment and install dependencies with pip.checked 13 Oct 2026
- Speech editing
- The site presents examples of editing existing speech by changing or adding words in a transcript.checked 12 Oct 2026
- Speech editing dependency
- Montreal Forced Aligner is used for speech editing, and the repository says it can be skipped if installation is difficult.checked 13 Oct 2026
- Speech generation
- Its token reordering mechanism uses time-aligned text and speech tokens to frame editing and synthesis as sequence generation.checked 13 Oct 2026
- Text processing
- The model uses Qwen3 for phoneme-free cross-lingual text processing.checked 13 Oct 2026
- Token mechanism
- The site describes a token reordering mechanism using time-aligned text and speech tokens.checked 12 Oct 2026
- Voice cloning
- The project describes its speech synthesis as voice-cloning and zero-shot TTS.checked 13 Oct 2026
Where it runs
- Platforms
- self_hostedchecked 20 Sep 2026
Alternatives to VoiceCraft-X
- 1
iSpeech
Free planOpen sourceAndroidiOSWebAPI8.5Free plan - 2
Voicebox
Free planOpen sourceAndroidiOSWebAPI8.5From $12 a year - 3
Resemble AI
Free planAndroidiOSWebAPI8.3From $280 a month - 4
Speechify
Free planAndroidiOSWebAPI8.3From $10 a month - 5
Voice.ai
Free planAndroidiOSWebAPI8.3From $5 a month - 6
Fliki
Free planAndroidiOSWebAPI8.2From $28 a month