- What is AI lip sync?
- A model that makes a mouth move in time with speech. Some animate a still photo into a talking video; others take a video that already exists and redraw the mouth to match new audio, which is how videos are dubbed into other languages.
- Which lip sync model should I use?
- To make a photo talk, OmniHuman 2.0: it takes the longest audio (2 minutes), follows a prompt for expression, gestures and camera, and costs less per second than OmniHuman 1.5. P-Video Avatar is the budget pick for clips up to 30 seconds, and OmniHuman 1.5 or P-Video Avatar give 1080p. To change what someone says in an existing video, Sync Lipsync 2.0, or 2.0 Pro for close-ups.
- Can I make any photo talk?
- A photo with one clearly visible face, looking roughly at the camera, works best: a portrait, a half-body shot, an illustrated character or even a pet. For OmniHuman 2.0 the picture's aspect ratio must be between 2:5 and 5:2; any size works, as small pictures are scaled up and very large ones down.
- What audio can I use?
- Speech in any language, as an MP3 or WAV file or recorded in the browser. You can also type a line and have it spoken by one of BudgetPixel's voices or your own cloned voice, for free. OmniHuman 2.0 takes up to 120 seconds of audio, OmniHuman 1.5 60 and P-Video Avatar 30; the Sync models re-sync videos up to 60 seconds long.
- How much does AI lip sync cost?
- Per second: OmniHuman 2.0 84 credits (4-second minimum), OmniHuman 1.5 135, P-Video Avatar 40 at 720p or 60 at 1080p, Sync Lipsync 2.0 55 and 2.0 Pro 90. The price is set aside when the job starts and charged only if it succeeds.
- How long does it take?
- A few minutes. In our tests a 6-second OmniHuman 2.0 clip took about 3 minutes, P-Video Avatar about 1 minute and Sync Lipsync about 2.
- Can I use lip sync through the API?
- Yes, for the photo models: OmniHuman 2.0, OmniHuman 1.5 and P-Video Avatar are in the BudgetPixel API under POST /v1/lip-sync/{model}, billed the same way as in the workshop. The Sync models are in the workshop only.