AI Glossary / Lip-sync

🎨 Image, video and audio

Lip-sync in the AI context is automatically matching the mouth movements of a character in video to an overlaid audio track. The model analyzes the sound and modifies the mouth (and often the entire facial expression) so it looks like the character is actually speaking those words. This is the technology behind the new generation of dubbing - a film "speaks" in a foreign language with the actor's lips - and behind talking avatars for courses and marketing. Paired with voice cloning, it delivers a complete synthetic speaker package, with all the good and bad consequences that entails.