Distinguishing Video Upscaling from Re-generation in AI Video APIs

Description and use

The article explains the difference between video upscaling and re-generation. Upscaling preserves motion and errors, useful for editing, while re-generation improves detail but alters motion. The author provides tests to identify the method and advice on tool selection.

Problem

Video APIs often advertise identical output resolutions (e.g., 2K) but use fundamentally different pipelines: post-hoc super-resolution (upscaling) versus conditioned re-generation. This distinction is critical for workflows requiring frame-perfect synchronization (e.g., editing, approval) versus those prioritizing detail fidelity, yet vendors rarely disclose which method they use.

Outcome

The article provides a practical method to distinguish between video upscaling and re-generation. It highlights that upscaling preserves motion and errors, making it suitable for editing workflows, while re-generation improves detail but introduces motion drift, making it better for final delivery. It also warns about cost implications and self-hosting limitations.

Workflow

• Generate a video clip at low resolution (e.g., 768p) containing legible text.
• Generate the same clip at high resolution (e.g., 2K) using the target API.
• Test 1 (Text): Compare the text in both versions. If the high-res text is a sharpened version of the low-res error, it is an upscaler. If the text is different (often correct), it is re-generation.
• Test 2 (Motion): Compare frame-by-frame motion. If frame N in high-res matches frame N in low-res exactly, it is an upscaler. If there is micro-motion drift (e.g., hair movement, hand timing), it is re-generation.
• Evaluate workflow fit: Use upscalers for preview-then-commit workflows requiring frame correspondence. Use re-generation for one-shot delivery where detail fidelity is paramount.
• Verify vendor documentation or ask specific questions about conditioning, frame correspondence, and model architecture to confirm the pipeline type.

Evidence

If it's an upscaler, the high-res glyphs are a sharpened version of the same wrong shapes.

Source

If your high-resolution render has frame-for-frame identical motion to your preview, you bought an upscaler.

Source

MiniMax H3 is the clearest implementation of Path B I've found... the 768P result is fed back through the model along with the original context and generated again at 2K.

Source