Sidequest: A 100% Offline Vision‑Language Scavenger Hunt Where the Screen Is the Shortest Part of the Walk

说明与用途

Sidequest 是一款完全离线的户外寻宝应用，利用开放权重视觉‑语言模型即时验证孩子发现的物体，屏幕时间最短，隐私得到保障。

问题

Parents give children digital games that replace outdoor exploration with addictive screens, while paper scavenger hunts cannot verify discoveries.

结果

Sidequest delivers a fully offline, on‑device vision‑language verification workflow that keeps screens minimal, protects privacy, and provides instant feedback to children and parents during outdoor scavenger hunts.

工作流

• Present a daylight‑readable naturalist clue on the phone
• Child walks and observes the environment with the screen dark
• Child taps camera to capture a photo of a candidate object
• On‑device quantized vision model evaluates the image in 43 ms and displays a Blaze progress bar
• If Blaze reaches 100 % a field note appears and the child can continue
• Parents may tap "Count it!" to override ambiguous matches
• After all 5 stops a printable field journal is generated locally

证据

Sidequest does not use artificial intelligence to glue eyes to glass. It uses an open-weight vision-language model running inside the browser as a quiet, objective trail referee:

来源

In just 43 milliseconds, an on-device quantized vision model evaluates whether the image genuinely matches the clue against competing distractors.

来源

The entire codebase is open-source under the Apache-2.0 License: https://github.com/Shreyansh00987/Sidequest

来源