Building Language Translation Apps with LLM, Speech Recognition, and Computer Vision

说明与用途

构建实时翻译应用，集成LLM、语音识别和计算机视觉，使用Oxlo.ai实现转录、视觉上下文、翻译和语音合成。

问题

Developing a real‑time, production‑grade language translation app that handles audio, visual context, and low‑latency inference across multiple model types.

结果

A complete, low‑latency translation pipeline that integrates speech, vision, LLM translation, and TTS using Oxlo.ai’s request‑based pricing and OpenAI SDK compatibility.

工作流

• Capture audio and send to Whisper for transcription
• Optionally capture image and send to a vision model (Gemma 3 27B or Kimi VL A3B) with the transcript
• Combine transcript and visual context into a translation prompt
• Send prompt to an LLM (Qwen 3 32B or Llama 3.3 70B) for translation
• Send translated text to Kokoro 82M for text‑to‑speech synthesis
• Output MP3 audio to the user

证据

Oxlo.ai hosts over 45 open‑source and proprietary models across seven categories, including audio, vision, chat, and speech.

来源

Because Oxlo.ai uses request‑based pricing, a long audio transcript or a detailed visual prompt costs the same flat rate per request regardless of input length.

来源