Why your YouTube transcript scraper returns the wrong language (and how to fix it)

说明与用途

YouTube 爬虫经常返回错误语言的字幕，导致 AI 流水线出现无声错误。解决方案是通过自动生成的语音识别轨道检测原始语言，然后选择该语言的最佳字幕，必要时使用 Apify Actor 进行生产部署。

问题

Scrapers often return captions in the wrong language, causing silent bugs in AI pipelines that consume transcripts.

结果

By selecting the auto-generated speech recognition track to determine the original language and then choosing human-made captions in that language, the scraper now reliably returns correct-language transcripts, avoiding silent bugs in downstream AI tasks.

工作流

• Identify if video is dubbed and read original audio track flag.
• Use language of auto-generated (speech recognition) track as reliable signal for spoken language.
• Select best captions in that language: prefer human-made, fall back to auto-generated if none.
• Handle cloud IP blocking by using residential proxies and retries.
• Optionally use Apify Actor for production deployment.

证据

9 of those 37 came back in the wrong language

来源

The problem: YouTube's caption list is not ordered by the original language.

来源

If you're using the open-source youtube-transcript-api library, step 2 looks roughly like this:

来源