Long-form video and the temporal coherence problem
Chapter 138
3 min read
Reviewed v78 · August 2026
Long-form video and the temporal coherence problem
The third frontier is video length. As of 2026, the longest coherent clips that frontier video models can produce are around 25 seconds (Sora 2 Pro), 15 seconds (Kling 3.0 cinematic mode), and 8 seconds (Veo 3.1, Wan 2.5, Seedance 2.0). Beyond those lengths, the models lose temporal coherenceTemporal coherenceThe property of video where elements remain consistent across frames. The central challenge of video generation., characters drift, objects appear and disappear, the scene morphs in ways the promptPromptThe text description you provide to a model to specify what you want it to generate. did not request. The technique that produces a coherent 8-second clipCLIPA text encoder developed by OpenAI in 2021 that learns to align text and images in a shared embedding space. Foundation of most text-to-image models from 2022 onward. does not generalize to a coherent 8-minute clip without something fundamentally new.
There are several research threads attempting to break this barrier. The first is hierarchical generation: produce a low-resolutionResolutionThe pixel dimensions of an image or video, for example 1024x1024. Higher resolution shows more detail but costs more memory and time. sketch of the entire long video first, then progressively refine it into the full video. This is the approach used by some long-form video research at Google and Meta, and it gets to 60-second clips with reasonable coherence but the quality is meaningfully worse than the short-form frontier models.
The second is autoregressiveAutoregressiveGenerating output one piece at a time, each conditioned on what came before, the way language models write text. Some image and video models work this way instead of by diffusion. video generation, where each new clip segment is conditioned on the previous segment. This is computationally cheaper than generating the whole video at once and lets you produce arbitrarily long videos in principle. The problem is error accumulation, small inconsistencies between segments compound over time, and after a few minutes the video has drifted away from the original premise. Recent work like StreamingT2V and CogVideoX-Flash addresses this with sliding-window attention and explicit memory mechanisms, but the results are still worse than short-form generation.
Fig.diagram
■Why long video drifts. Autoregressive generation conditions each new segment on the last, which is cheap, but small errors compound segment over segment until faces morph and color creeps. Holding coherence across minutes, not seconds, is the unsolved problem.
The third is the one I think is most likely to win, which is to treat long-form video as a fundamentally different problem from short-form video and build dedicated architectures for it. The key insight is that long-form video has a hierarchical structure that short-form does not, there are scenes, shots, and beats, and the right level of compression is different at each level. A research direction called 'scene-aware video generation' is trying to encode this structure explicitly, generating videos as a tree of scenes and shots rather than as a flat sequence of frames. This is closer to how a human filmmaker would think about a long video, and it may be the architectural insight that breaks the length barrier.
The practical timeline for usable long-form video generation is probably 18 to 36 months. Sora 1's preview release in February 2024 already showed clips up to a minute long with rough coherence; the difference between that and a usable production tool is mostly polish and reliability. By 2027, generating coherent two-to-three-minute clips with named characters and consistent settings should be feasible. By 2028, longer narrative pieces. By 2029 or 2030, the question of 'can AI generate a feature film' will have been answered (probably with: 'yes, but the quality bar for theatrical release will still require significant human curation').
Check your understanding
pass: 5 of 7
Answer at least 5 of 7 correctly to unlock the next chapter.
1. As of 2026, which model produces the longest coherent clips?
2. What happens when video models exceed their coherent length limit?
3. In the tweet-versus-novel analogy, why is an 8-minute clip like a novel?
4. What is the hierarchical generation approach to long-form video?
5. What is the main problem with autoregressive long-form video generation?
6. Which approach does the author think is most likely to break the length barrier?
7. What is the practical timeline given for usable long-form video generation?
The weekly briefing
Get the week's moves in your inbox.
A short, sourced digest of what actually moved across generative AI, every week. Free.
Free. One email a week, no spam, unsubscribe anytime. Prefer a reader? RSS.