Name it, then look up: a field guide where the phone's job ends after one photo
Описание и применение
Spotted – мобильное приложение‑путеводитель, которое быстро определяет вид из фотографии, а затем заставляет пользователя наблюдать за ним в течение 60 секунд, сохраняя наблюдение в записи.
Задача
Nature apps often name an animal quickly, but by the time the name is displayed the animal has moved on, leaving users without a meaningful learning moment.
Результат
Spotted delivers a quick species name and then a focused 60‑second observation prompt, keeping all data offline after initial model download and providing a lightweight social trail.
Рабочий процесс
- Take or upload a photo of a bird, lizard, insect, tree or plant
- The CLIP model suggests a name; if confidence <0.12 or gap <0.04, show "Not in my guide yet" and maybes
- Press "Look up" to load Gemma 3 270M and request one observation sentence
- Screen dims to a 60‑second timer; Gemma returns a sentence starting with "Watch"
- When the minute ends or user taps "I looked", answer "What did you notice?" and save the note
Доказательства
Most nature apps have the same quiet problem. You see a bird, you lift your phone, and by the time the app has told you its name, the bird has gone and you're still reading about it.
Spotted is a pocket field guide that runs on your phone, in the browser. You take or upload one photo of a bird, lizard, insect, tree or plant. An open model suggests a name from the field guide. Then a button called Look up asks a second open model, Gemma, for one thing to notice.
The first time, Gemma downloads into your browser (about 308 MB, so use Wi‑Fi). Then the screen dims and gives you one thing to notice.
Gemma generating the one sentence (WASM) – about 20 s
CLIP naming a photo once cached – about 7 s in a headless phone‑sized browser
- Дата записи: 2026-10-12T01:41:08.280Z