Touch Grass Check: an AI that makes sure you went outside

说明与用途

一个网页应用，使用本地运行的 CLIP 模型来验证用户是否真的外出，并识别照片中的植物。

问题

Users want to verify they actually went outside and identify plants they saw.

结果

The app successfully identifies outdoor photos and names plants from a curated list, running entirely in the browser without sending images to a server.

工作流

• Take or upload a photo
• The browser runs an open‑source AI model (CLIP via Transformers.js) to decide if the photo is outdoors in nature
• If outdoors, the app displays "Touch grass: confirmed"; otherwise it prompts the user to go outside
• The AI names the plant from a predefined list of 126 common plants, flowers, and trees
• The app fetches the plant’s origin and description from Wikipedia
• The user can copy the result, download it as a .txt file, or save it as a PDF

证据

Take or upload a photo.

An open-source AI model (CLIP, running in your browser with Transformers.js) decides whether the photo is outdoors in nature.

The photo never leaves the device. The model runs locally, and only the plant name is sent to Wikipedia.

It wasn't perfect. It was too strict about a close-up stock photo of a rose, but it passed a real photo of grass from my street.

The first visit downloads the model, so it's slow once, then faster.