Contents

138 / 153

The Research Frontier

Character consistency and identity preservation

Chapter 137

3 min read

Reviewed v78 · August 2026

The second major frontier is character consistency, the problem of generating multiple images of the same character that all clearly show the same person, with the same facial features, body type, and visual identity, across different poses, settings, and styles. This is the single hardest unsolved problem in generative imagery for narrative use cases (comics, storyboards, animation pre-production, longform video) and the technique that solves it well will unlock an entire category of applications that do not really work yet.

The current solutions are partial. Intellectual Property (IP)-Adapter, introduced in 2023 by Tencent's research team, lets you provide a reference image alongside your text prompt and biases the generation to look like the reference. It works well for capturing general identity (this is the same person) but struggles with fine details (it is not exactly the same person). Subject LoRAs, covered in the Low-Rank Adaptation (LoRA) section, are the other main approach, train a custom LoRA on 20-40 photos of the subject and use it for all generations. This works much better but requires per-character training and produces drift across generations within a single project.

The frontier work in 2025-2026 has produced more sophisticated approaches. StoryDiffusion, introduced by a team at Nankai University and ByteDance, reformulates the diffusion process to maintain consistency across a sequence of images by sharing attention between them, instead of generating each image independently, the model jointly attends to all images in the sequence and enforces feature consistency. The result is that a generated 'comic strip' has visibly the same character across panels without requiring per-panel training. Concurrent work like InstantID and PhotoMaker pushes the IP-Adapter approach further, getting closer to one-shot identity preservation from a single reference image.

The other thread is from the video model side. Sora's technical report claimed emergent character consistency over short clips. Veo 3 demonstrably handles character consistency over its 8-second clips. The mechanism is different from the image-side techniques, for video, the model is naturally producing a temporally coherent sequence and identity preservation is a side effect of the underlying video architecture. The interesting research question is whether the techniques that work for video can be back-ported to images. Early results suggest yes, and the next generation of image models (FLUX 2, presumably; SD4, presumably) will probably have meaningful character consistency built into the base model rather than requiring per-character LoRAs.

01

What changes when this is solved

Once character consistency works reliably, several new product categories become viable. Animated narratives produced by individual creators become possible at scale (right now they require either heroic per-frame curation or an animation studio). Character-driven advertising campaigns can be produced without hiring the actors who would normally be the consistency anchor. Comic and graphic novel production becomes faster by orders of magnitude. AI-generated TV shows with persistent characters become a real possibility. The 'visual narrative' space is currently bottlenecked by character drift, and removing that bottleneck is going to release a wave of products.

Check your understanding

pass: 5 of 7

Answer at least 5 of 7 correctly to unlock the next chapter.

  1. 1. In the police sketch analogy, what does IP-Adapter correspond to?

  2. 2. How does IP-Adapter perform on identity preservation?

  3. 3. What is the trade-off of using subject LoRAs for consistency?

  4. 4. How does StoryDiffusion maintain consistency across a sequence of images?

  5. 5. Why does character consistency emerge more naturally in video models?

  6. 6. What is the frontier research goal for character consistency?

  7. 7. What new product category becomes viable once character consistency works reliably?

The weekly briefing

Get the week's moves in your inbox.

A short, sourced digest of what actually moved across generative AI, every week. Free.

Free. One email a week, no spam, unsubscribe anytime. Prefer a reader? RSS.