Ultra‑Low Latency Local‑First Interview Copilot

Описание и применение

WishPilot – локальный помощник для интервью с субсекундной задержкой, использующий Electron, React 19 и Groq Whisper Turbo, без передачи данных в облако.

Задача

Conventional conversational AI assistants suffer from 8–10 s latency and require uploading private audio and credentials to cloud servers, which is unacceptable for live interviews and raises privacy concerns.

Результат

WishPilot achieves sub‑second speech intelligence on a desktop, eliminates privacy risks by keeping all data local, and provides a real‑time interview assistant with customizable answer refinement.

Рабочий процесс

• Capture microphone audio via AudioWorkletNode
• Downsample to 16 kHz PCM and run VAD
• Send audio chunk to Groq Whisper Large v3 Turbo over HTTPS
• Receive STT and synthesize context (resume, domain, vision)
• Stream LLM response through Unified AI Streaming Engine (BYOK)
• Display answer in floating HUD with WDA_EXCLUDEFROMCAPTURE
• Offer quick‑action pills for answer refinement

Доказательства

The spoken question is transcribed with technical vocabulary accuracy in under 250 milliseconds.

Источник

WishPilot has zero central backend servers. No telemetry pings, no user tracking, and no database holding interview transcripts.

Источник