Hallo
Hallo generates an animated portrait video from a still image and driving speech audio.
What Hallo is
Hallo generates an animated portrait video from a still image and driving speech audio. Its audio-driven synthesis is designed to coordinate lip movement, facial expression and pose with the sound, and inference options provide separate weights for pose, face and lips. The input portrait should be square, with a forward-facing face filling 50%–70% of the image and rotated less than 30 degrees. Driving audio must be a clear-vocal English WAV file; background music is acceptable. The default output is an MP4 saved to `.cache/output.mp4`, though users can choose another path. Hallo is free and open source under an MIT license. Its listed system requirements are Ubuntu 20.04 or 22.04 and CUDA 12.1, and the project says it tested the software on A100 GPUs. Pretrained checkpoints and supporting models are available through its Hugging Face repository. The project also provides training and data-preprocessing code, including multi-node and multi-GPU support, and links community resources for Windows, ComfyUI, a WebUI, Docker and RunPod. Its project materials identify deepfake misuse, privacy and consent as risks and call for responsible use.
Good
- Free and open source under an MIT license
- Separate inference weights for pose, face and lips
- Supports a custom output path
- Pretrained models and training code are available
Watch out
- Driving audio must be English WAV
- Portrait images must meet specific framing requirements
- Listed system requirements include CUDA 12.1
- A100 is the only tested GPU listed
Who it suits
Hallo is for developers and creators who can work with its listed Linux and CUDA requirements and want to generate portrait animation from an image and English speech audio. Its training code may also suit people developing or adapting models.
Verdict
Hallo provides controls for generating speech-driven portrait videos, with model and training resources available. Its input constraints and listed system requirements are important to check before starting.
The facts
Each one read from Hallo's own pages, with the date it was checked.
What it does
- Audio requirements
- Driving audio must be a WAV file in English, with clear vocals; background music is acceptable.checked 8 Oct 2026
- Community integrations
- The repository links community resources for ComfyUI, a WebUI, Windows, Docker, and RunPod.checked 4 Oct 2026
- Image requirements
- The source image should be square, show the face as 50%–70% of the image, and have a forward-facing head with less than 30° rotation.checked 8 Oct 2026
- Input image requirements
- The source image should be square, with a forward-facing face occupying 50%–70% of the image and rotated less than 30 degrees.checked 4 Oct 2026
- Inputs and output
- Inference takes a source image and driving audio and saves an animation as an MP4 video by default.checked 8 Oct 2026
- Installation
- The project lists Ubuntu 20.04 or 22.04 and CUDA 12.1 as system requirements, and says it tested the software on A100 GPUs.checked 8 Oct 2026
- Language limitation
- The README says the model's training datasets are only in English and lists improving Mandarin performance as a roadmap item with no estimated date.checked 8 Oct 2026
- License
- GitHub identifies the repository as MIT-licensed.checked 8 Oct 2026
- Model downloads
- Pretrained models for inference are available from the project's Hugging Face repository, with separate downloads also listed for components such as wav2vec and Stable Diffusion 1.5.checked 8 Oct 2026
- Motion controls
- Inference options include separate pose, face, and lip weights.checked 4 Oct 2026
- Motion synthesis
- Its hierarchical audio-driven synthesis is designed to align lip, expression, and pose motion with audio.checked 4 Oct 2026
- Output
- Inference saves an MP4 video to `.cache/output.mp4` by default, with an option to choose another output path.checked 4 Oct 2026
- Privacy and misuse
- The project identifies deepfake misuse and image and voice privacy and consent as social risks, and calls for responsible use, informed consent, and privacy safeguards.checked 4 Oct 2026
- Purpose
- Hallo is a system for audio-driven visual synthesis that animates portrait images.checked 8 Oct 2026
- Responsible use
- The project notes risks involving deepfakes, privacy, and consent, and calls for ethical guidelines, transparent data use, informed consent, and privacy safeguards.checked 8 Oct 2026
- System requirements
- The listed system requirements are Ubuntu 20.04 or 22.04 and CUDA 12.1; the tested GPU is A100.checked 4 Oct 2026
- Training
- The project provides data-preprocessing and training code, including support for multi-node and multi-GPU training.checked 8 Oct 2026
The company
- Founded
- 2024checked 28 Sep 2026
- Research team
- The listed authors are affiliated with Fudan University, Baidu, ETH Zurich, and Nanjing University.checked 8 Oct 2026
Where it runs
- Windows and integrations
- The project README lists community contributions for a Windows version, ComfyUI integration, WebUI, and a Docker template.checked 8 Oct 2026
- Windows support
- The repository links a community Windows version and installation guide.checked 4 Oct 2026
Alternatives to Hallo
- 1
Sync Labs
Free planAndroidiOSWebAPI8.0From $5 a month - 2

Morph Studio
Free planiOSWeb7.8From $12 a month - 3
VEED
Free planAndroidiOSWebExtension7.5Free plan - 4
Muse
Free planOpen sourceLinuxmacOSSelf-hostedWindows7.4Free plan - 5

CHAMELAION LipSync API
Free planWebAPI7.3From €5 a month - 6

lipsyn.cc
Free planWebAPI7.3€11.99 one-time
