Banuba, a market leader in augmented reality (AR) technologies, today announced the development of a groundbreaking AI-powered lip sync video generation feature for its Video Editor SDK. This technology marks a significant leap forward in creating hyper-realistic AI videos, as it enables people in the frame to mimic spoken or sung words with unprecedented accuracy and naturalism. See the demo video to learn more.

The new feature leverages advanced neural networks to analyze a provided audio track, processing the nuanced phonemes and rhythms of speech or song. It then automatically generates the corresponding facial movements, including lip shapes, tongue placement, and jaw motion. This eliminates the uncanny valley effect often associated with digital characters, delivering a believable performance.

Beyond lip movement, Banuba’s solution offers unparalleled creative control. Users can input text prompts to modify other aspects of the person’s performance, e.g. adjusting gestures, head movements, and overall emotional expression. For instance, a prompt could instruct the person to “speak confidently with open hand gestures” or “sing sadly while looking downward,” allowing for dynamic video generation without manual animation.

“We are moving into the realm of interactive AI-driven storytelling,” said Anton Liskevich, CPO/Co-founder at Banuba. “This lip sync video generation is a game-changer for developers creating virtual influencers, interactive educational content, personalized marketing videos, and immersive social media experiences. It dramatically reduces production time and cost while boosting creative potential.”

The Banuba Video Editor SDK is an all-in-one toolkit for video editing and effects. Developers can integrate it quickly (sometimes in less than 8 minutes) and give their users everything they need to create impressive content.

Core features of the Video Editor SDK include:

• AI clipping
• Beauty filters
• Royalty-free music
• Sound editing
• Transition effects
• 2D and 3D face effects
• Color filters
• AI subtitle generation
• Trimming & Merging

About Banuba:

Banuba is an augmented reality company with over 9 years on the market, pioneering artificial intelligence, face tracking, virtual try-on, and virtual background technologies. Banuba provides software development kits (SDKs) for augmented reality and video editing, as well as ready-to-integrate solutions for virtual try-on on face, hair and hand.

View source version on businesswire.com: https://www.businesswire.com/news/home/20251024322153/en/

“We are moving into the realm of interactive AI-driven storytelling,” said Anton Liskevich, CPO/Co-founder at Banuba. “This lip sync video generation feature dramatically reduces production time and cost while boosting creative potential."