I Built a Local AI Music Studio

说明与用途

Miso 是一个本地 AI 音乐工作室，集成了多种音乐模型和后处理工具，使用 Docker 容器运行，提供统一的生成、编辑和混音工作流。

问题

Users want a single interface to experiment with local music models and manage post‑generation tasks such as editing, stem separation, voice conversion, and MIDI transcription.

结果

Miso enables local, GPU‑accelerated music generation and post‑processing workflows, reducing the need for multiple command‑line tools and allowing users to experiment with different models and editing techniques while preserving project lineage.

工作流

• 1. Install Miso via Docker Compose. 2. Select a music model (e.g., ACE‑Step 1.5, YuE2, MiniMax Music 3, HeartMuLa, Stable Audio 3).
• 3. Input a prompt or upload a file. 4. Generate a full song or repaint a selected waveform section.
• 5. Use the stem separation tool to split the track into vocals, drums, bass, etc.
• 6. Transcribe a vocal stem to MIDI notes. 7. Convert MIDI to an ABC score and adjust tempo/key. 8. Feed the score to YuE2 to generate a new arrangement.
• 9. Mix, solo, mute, or replace stems using the built‑in mixer. 10. Export the final take as WAV or MP3.

证据

Miso is a self‑hosted local music generation and remix studio built on top of audio.cpp.

来源

The whole thing runs as two Docker containers. One runs Miso itself. The other runs audio.cpp and owns the GPU models.

来源

You can separate a song, transcribe the vocal stem, turn those note events into an ABC melody, inspect the detected tempo and key, correct them if necessary, and feed the score into YuE2 with a completely different style.

来源