Contents

139 / 153

The Research Frontier

Long-form video and the temporal coherence problem

Chapter 138

3 min read

Reviewed v78 · August 2026

The third frontier is video length. As of 2026, the longest coherent clips that frontier video models can produce are around 25 seconds (Sora 2 Pro), 15 seconds (Kling 3.0 cinematic mode), and 8 seconds (Veo 3.1, Wan 2.5, Seedance 2.0). Beyond those lengths, the models lose temporal coherence, characters drift, objects appear and disappear, the scene morphs in ways the prompt did not request. The technique that produces a coherent 8-second clip does not generalize to a coherent 8-minute clip without something fundamentally new.

There are several research threads attempting to break this barrier. The first is hierarchical generation: produce a low-resolution sketch of the entire long video first, then progressively refine it into the full video. This is the approach used by some long-form video research at Google and Meta, and it gets to 60-second clips with reasonable coherence but the quality is meaningfully worse than the short-form frontier models.

The second is autoregressive video generation, where each new clip segment is conditioned on the previous segment. This is computationally cheaper than generating the whole video at once and lets you produce arbitrarily long videos in principle. The problem is error accumulation, small inconsistencies between segments compound over time, and after a few minutes the video has drifted away from the original premise. Recent work like StreamingT2V and CogVideoX-Flash addresses this with sliding-window attention and explicit memory mechanisms, but the results are still worse than short-form generation.

Fig.diagram
SEGMENT 1 (SEED)SEGMENT 6 (DRIFTED)+0s+4s+8s+12s+16s+20saccumulated errorface morphs, color creepsCheap, but each error rides forward.Holding coherence across minutes, not seconds, is the unsolved problem.
Why long video drifts. Autoregressive generation conditions each new segment on the last, which is cheap, but small errors compound segment over segment until faces morph and color creeps. Holding coherence across minutes, not seconds, is the unsolved problem.

The third is the one I think is most likely to win, which is to treat long-form video as a fundamentally different problem from short-form video and build dedicated architectures for it. The key insight is that long-form video has a hierarchical structure that short-form does not, there are scenes, shots, and beats, and the right level of compression is different at each level. A research direction called 'scene-aware video generation' is trying to encode this structure explicitly, generating videos as a tree of scenes and shots rather than as a flat sequence of frames. This is closer to how a human filmmaker would think about a long video, and it may be the architectural insight that breaks the length barrier.

The practical timeline for usable long-form video generation is probably 18 to 36 months. Sora 1's preview release in February 2024 already showed clips up to a minute long with rough coherence; the difference between that and a usable production tool is mostly polish and reliability. By 2027, generating coherent two-to-three-minute clips with named characters and consistent settings should be feasible. By 2028, longer narrative pieces. By 2029 or 2030, the question of 'can AI generate a feature film' will have been answered (probably with: 'yes, but the quality bar for theatrical release will still require significant human curation').

Check your understanding

pass: 5 of 7

Answer at least 5 of 7 correctly to unlock the next chapter.

  1. 1. As of 2026, which model produces the longest coherent clips?

  2. 2. What happens when video models exceed their coherent length limit?

  3. 3. In the tweet-versus-novel analogy, why is an 8-minute clip like a novel?

  4. 4. What is the hierarchical generation approach to long-form video?

  5. 5. What is the main problem with autoregressive long-form video generation?

  6. 6. Which approach does the author think is most likely to break the length barrier?

  7. 7. What is the practical timeline given for usable long-form video generation?

The weekly briefing

Get the week's moves in your inbox.

A short, sourced digest of what actually moved across generative AI, every week. Free.

Free. One email a week, no spam, unsubscribe anytime. Prefer a reader? RSS.