EcoQuest: put your phone away and let an open model check your discoveries

Описание и применение

EcoQuest позволяет пользователям гулять на природе, беря фото только при обнаружении интересного объекта, а открытая модель AI проверяет соответствие фото заданию, выдавая краткий отчёт.

Задача

Outdoor apps often force users to stare at screens, reducing real-world engagement.

Результат

EcoQuest enables low-attention outdoor exploration by leveraging an open AI model to verify discoveries, producing a simple record without requiring accounts or location tracking.

Рабочий процесс

• Start expedition – view safety notice and keep phone in pocket
• Pick a mission – receive clear instruction
• Walk and take photo when something matches the mission
• Upload photo – inference service runs SigLIP2 and returns a confidence score
• App marks mission as complete or unverified based on threshold
• View results – short record of discoveries

Доказательства

EcoQuest does the opposite. You pick an expedition, put your phone in your pocket, walk, and take a photo only when you find something. An open-weight AI model checks whether the photo matches the mission, and at the end you get a short record of what you discovered.

Источник

The inference service (<code>inference/</code>) Implemented; 27 tests; tested with the real model and with synthetic images

Источник

The model is google/siglip2-base-patch16-256, an open-weight vision-language model under Apache-2.0. It runs zero-shot: each mission has a few text prompts…

Источник

The thresholds are provisional. They were tuned on 42 Wikimedia Commons photos, not on photos from the park or taken with a phone, so I have not yet measured how the model does on real park photos.

Источник