AI Filmmaking: Vibe Directing and Agentic Production
Sound and post: the underrated stage
Chapter 113
1 min read
Reviewed v78 · August 2026
Sound and post: the underrated stage
Sound is roughly half of what makes a film feel finished, and it is the stage where this part meets the book's audio pillar directly. Three things changed at once. Dedicated voice tools matured, so dialogue and speech-to-speechSpeech-to-speechConverting a recorded performance into another voice while keeping the original timing and emotion, the approach serious film work prefers over pure text-to-speech.performance transferPerformance transferDriving a generated character with a real performer's captured head, face, and body motion from a video, rather than from an audio track, as in Runway's Act-Two. became reliable: an actor voices a line with the right emotion and it is mapped onto a character's voice, preserving tone, cadence, accent, breaths, and the timing between words, with ElevenLabs the default. This is the audio equivalent of Act-One, and it matters for the same reason: a human performs, so the emotional read is real rather than synthesized from text. Music and sound-effect generation became good enough to score a short and lay in foleyFoleyThe everyday sound effects of a scene, footsteps, cloth, impacts, now increasingly generated from the video itself. without a library. And the frontier video models began generating synchronized native audio in the same pass as the picture, so lip-sync, footsteps, and room tone arrive attached to the shot rather than added later.
Check yourself0 / 5
Q01
Why is performed speech-to-speech transfer called the audio equivalent of Act-One?
Q02
As native audio makes casual in-context sound nearly free, where does the skill migrate?
Q03
What choices does a maker who 'sounds professional' actually make?
Q04
Why is dialogue still the genre's weakest point?
Q05
How do most polished AI films route around their dialogue weakness?
The weekly briefing
Get the week's moves in your inbox.
A short, sourced digest of what actually moved across generative AI, every week. Free.
Free. One email a week, no spam, unsubscribe anytime. Prefer a reader? RSS.