Building Language Translation Apps with LLM, Speech Recognition, and Computer Vision

Описание и применение

Создание приложения для перевода в реальном времени с использованием LLM, распознавания речи и компьютерного зрения, объединяющего транскрипцию, визуальный контекст, перевод и синтез речи через Oxlo.ai.

Задача

Developing a real‑time, production‑grade language translation app that handles audio, visual context, and low‑latency inference across multiple model types.

Результат

A complete, low‑latency translation pipeline that integrates speech, vision, LLM translation, and TTS using Oxlo.ai’s request‑based pricing and OpenAI SDK compatibility.

Рабочий процесс

• Capture audio and send to Whisper for transcription
• Optionally capture image and send to a vision model (Gemma 3 27B or Kimi VL A3B) with the transcript
• Combine transcript and visual context into a translation prompt
• Send prompt to an LLM (Qwen 3 32B or Llama 3.3 70B) for translation
• Send translated text to Kokoro 82M for text‑to‑speech synthesis
• Output MP3 audio to the user

Доказательства

Oxlo.ai hosts over 45 open‑source and proprietary models across seven categories, including audio, vision, chat, and speech.

Источник

Because Oxlo.ai uses request‑based pricing, a long audio transcript or a detailed visual prompt costs the same flat rate per request regardless of input length.

Источник