Feverdream: Generating Retro CGI Video with LLM and POV-Ray

说明与用途

Feverdream 项目使用 30 亿参数的语言模型和 POV-Ray 光线追踪器生成连贯的复古 CGI 视频。与扩散模型不同，此工作流在消费级硬件上提供完美的时序一致性、精确控制和极低的计算成本。

问题

AI video diffusion models are expensive, computationally heavy, inconsistent, and hard to control, often resulting in geometric hallucinations and temporal incoherence.

结果

The workflow produces coherent, period-accurate CGI video with perfect temporal coherence and exact control, running on consumer hardware at negligible cost compared to diffusion models.

工作流

• Define a plain-English prompt describing the desired scene (e.g., 'chrome dolphin over a neon fractal canyon').
• Use ai_scene.py to send the prompt to a local LLM (default: qwen2.5-coder-3b-q4.gguf) via an OpenAI-compatible endpoint.
• The LLM generates a POV-Ray Scene Description Language (SDL) file, constrained by a system prompt to use specific 'retro90s.inc' macros for authentic 90s aesthetics.
• Run the sanitize() function to clean the LLM output, removing markdown fences, leading prose, and fixing common syntax errors like nested textures or incorrect color scaling.
• Render the sanitized SDL file using POV-Ray, a deterministic raytracer, to produce the final video frames.
• Compile the rendered frames into a video file.

证据

A small LLM (a 3B coder model, running at ~95 tokens/sec on a consumer GPU) writes a POV-Ray scene description... Then POV-Ray, a deterministic raytracer with a 30-year lineage, renders it.

来源

Temporal coherence is perfect. There's one real 3D scene. Objects don't morph between frames because they can't — they're geometric primitives with fixed coordinates.

来源