building a dual synchronized dag engine: audio dsp and gpu shaders in lockstep

Описание и применение

Инструмент Infinite синхронизирует аудио‑DSP и GPU‑шейдеры в реальном времени, устраняя задержки и джиттер, используя атомарные массивы модуляции и общий транспортный таймер.

Задача

Audio and visual pipelines run in separate universes, causing latency and jitter when synchronized via OSC, MIDI clock, or Syphon.

Результат

Audio and visual outputs are synchronized to sample accuracy without added latency, enabling real‑time multimedia performances.

Рабочий процесс

• 1. Master transport clock coordinates tick‑accurate time across both sub‑graphs.
• 2. Audio buffers produce 8‑band FFT analysis and onset peaks, writing into atomic double‑buffered modulation arrays.
• 3. Shader uniforms read directly from these arrays during the render pass, removing frame‑delay buffering.
• 4. Hosted AU and VST3 plugin parameters can be modulated by 3D scene coordinates, JavaScript sketches, or LFO generators.

Доказательства

how infinite synchronizes a sample-accurate, pull-based audio graph with a real-time opengl texture pipeline in c++.

Источник

audio buffers produce real-time 8-band fft analysis and onset peaks that write into atomic double-buffered modulation arrays.

Источник

shader uniforms (glsl) read directly from these modulation arrays during the render pass, eliminating frame-delay buffering.

Источник

infinite is open source (mit/gplv3) and runs cross-platform on macos, windows, and linux.

Источник