Your auto-captioner is measuring the wrong thing: a ratio that fired on a perfectly good clip

说明与用途

AI 视频自动字幕生成：通过对齐脚本文本与 Whisper 定时，并过滤低语速段落，解决同步和过长字幕问题。

问题

Automatic captioning of AI‑generated ad videos produced out‑of‑sync or overly long subtitles due to mismatched timing and text sources.

结果

Accurate subtitles that match the spoken content and timing, eliminating long static captions and mis‑aligned text.

工作流

• Generate video clip
• Extract audio and run Whisper transcription to get timing and text
• Align script lines with Whisper segments using word‑count weighting
• Generate .ass file with aligned timings and script text
• Burn subtitles with ffmpeg
• Apply speech‑rate guard: if any segment’s words‑per‑second < 1.5, fallback to hand‑written cues

证据

Take timing from the audio, take text from the script.

来源

If any single segment covers more than 40% of the clip, distrust the timing

来源