Separate Dialogue, Music, and Sound Effects in ComfyUI

Описание и применение

В этом рабочем процессе пользователь использует интеграцию ComfyUI-DBS для разделения диалога, музыки и звуковых эффектов в видео, сохраняя музыку и эффекты, а диалог сохраняется отдельно.

Задача

A video arrives with a single mixed soundtrack; muting removes all audio, but the goal is to replace only the dialogue while preserving music and sound effects.

Результат

The workflow successfully separates dialogue from music and SFX, allowing the user to replace or remove dialogue while keeping the original background audio intact.

Рабочий процесс

• Load Video → Get Video Components (extract frames, frame rate, audio)
• DBS Loader → DBS Separate (split audio into music, SFX, speech)
• Merge Audio (set to add) to combine music and SFX
• Create Video → Save Video (write video with combined soundtrack)
• Save separate dialogue track as FLAC

Доказательства

I built ComfyUI-DBS to bring that separation into a ComfyUI workflow. It splits a soundtrack into music, sound effects, and speech, then lets you save the parts or combine them again.

Источник

The workflow performs these steps: Load Video → Get Video Components, DBS Loader → DBS Separate, Merge Audio, Create Video → Save Video, and a separate audio output saves the dialogue as FLAC.

Источник

It runs locally on a CPU or NVIDIA CUDA GPU. The two available models total about 23 MB to download.

Источник

For dialogue removal, the workflow adds music + SFX and uses that as the video's new soundtrack.

Источник

The verification report records: Six CPU comparison cases: the pack's raw output matched the official package byte for byte.

Источник