Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

TerraQuest: Put the Phone in Your Pocket, Let an Open-Weight Model Name the Animals and Plan

说明与用途

TerraQuest 让用户在不看手机的情况下行走,后台跟踪路线,朗读任务,使用 CLIP 模型识别植物和动物,并将结果保存到行走日志中。

问题

Outdoor apps keep users staring at screens, interrupting the walking experience and hindering learning about nearby nature.

结果

TerraQuest enables uninterrupted walking, provides spoken missions, identifies wildlife offline or online, records walks, and offers a post‑walk journal, fostering a habit of mindful nature exploration.

工作流

  • Start walk – GPS route and timer run in background
  • Walk and take a photo of a plant, bird, insect or animal
  • If online, send photo to serverless function that calls a cloud vision model
  • If offline or cloud fails, run CLIP ViT‑B/32 (Xenova/clip‑vit‑base‑patch32) in the browser via Transformers.js
  • Score photo against ~70 nature labels tuned for Indian walks
  • Return name and scientific name, create result card
  • Save photo, GPS, time, and name to journal
  • Pin result on map and update route
  • Generate next mission
  • Stop walk – generate walk report

证据

The first scan downloads the on‑device model once. After that, scanning works without a connection.

来源

Walks track themselves. GPS distance, active time and estimated calories run without you touching anything.

来源

Missions are read aloud. Prompts like "listen for a bird for 10 seconds" are spoken, and you can answer by voice.

来源

  • 记录日期: 2026-10-08T21:56:04.048Z