I'm not getting up: a voice remote for YouTube that runs fully offline (and understands Pidgin)

说明与用途

该系统允许在Mac上使用语音控制YouTube播放，完全离线运行，并支持Pidgin命令。

问题

Controlling YouTube playback from a couch without a remote, keyboard, or internet access.

结果

The system achieves 28/30 correct command recognition, with 91% accuracy on unseen Pidgin phrases, and an average latency of ~190 ms when thinking mode is disabled.

工作流

• 1. User says wake word "Hey Jarvis".
• 2. openWakeWord detects wake word and starts recording.
• 3. webrtcvad detects end of speech and stops recording.
• 4. Whisper (mlx-whisper small) transcribes audio to text.
• 5. Gemma 4 E2B via Ollama parses text and returns JSON command.
• 6. AppleScript sends command to Chrome to control YouTube player.
• 7. A pixel sloth icon appears to confirm command reception.

证据

It controls YouTube in Chrome on my Mac. No remote, no keyboard, no getting up. Everything runs on my laptop: no internet, no account, no API key.

来源

I tested 30 phrases on two local models. 22 of them were phrases the model had never seen as examples, including Pidgin I made up on the spot.

来源

Gemma 4's two misses both returned <code>none</code>, so it just didn't act. Gemma 3's misses were actions: it paused the video when I said "tell me a joke", and when I said "make we go back two minutes" it went forward two minutes.

来源