Adaptive ΔE00 feedback control: engineering GPU-resident perceptual locks for Shadow’s MiniMax Direct multimodal rendering pipeline

说明与用途

基于GPU的ΔE00反馈控制循环保持实时渲染颜色与主参考一致，消除色彩漂移。

问题

Perceptual drift in real‑time rendering causes skin tones and logos to shift color over long playback, degrading visual fidelity.

结果

The system eliminates perceptual drift, keeping output color consistent with the master reference while running entirely on the GPU with no per‑frame readbacks.

工作流

• 1. Sample color tiles from master reference and rendered output in a compute shader using ΔE00.
• 2. Aggregate per‑tile errors and run a PID‑style adaptive controller in a second compute shader.
• 3. Write updated transform coefficients to a uniform buffer.
• 4. Consume updated coefficients in the next frame before tone mapping and gamut compression.
• 5. Host‑side TypeScript orchestrator boots the pipeline, binds textures, dispatches shaders, and collects coarse telemetry every ~250 ms.

证据

We precompute the L*a*b* conversion in a lookup texture and only run the rotation term in the inner loop.

来源

Everything stays in VRAM. We have a hard rule: no readbacks per frame.

来源