SnapNature: Identify Nature with Open-Source AI — Touch Grass Challenge

说明与用途

SnapNature 是一款 PWA，使用开放的 HuggingFace 模型实现快速、隐私优先的植物和动物识别，支持离线使用。

问题

Users want a mobile-friendly way to identify plants, animals, and natural scenes without relying on proprietary APIs or internet connectivity.

结果

SnapNature enables instant, privacy‑first nature identification on any device, offline, with open‑weight models and easy model swapping.

工作流

• Take a photo of a natural object
• Upload or capture image in the web interface
• Send image to HuggingFace ViT model for inference
• Receive top‑5 predictions with confidence scores
• Display educational facts and store observation in local journal
• Optionally swap the model for fine‑tuned regional models

证据

SnapNature uses a pre-trained ResNet50 model (ImageNet) to classify images.

来源

Take a photo of any plant, animal, or nature scene

来源

Works offline via Service Worker — go to a trail, no signal needed

来源