Grass Bingo: a daily nature card your phone checks offline, with an open-weight model
Description and use
Grass Bingo is a daily 4×4 nature bingo card that lets users photograph items and have an open‑weight CLIP model running in the browser verify matches, all offline with no data upload. The app stores only local progress and can be hosted on GitHub Pages.
Problem
People want a simple, privacy‑preserving way to get outside and find small nature items without relying on a server or uploading photos.
Outcome
Grass Bingo provides a privacy‑first, offline‑capable daily nature bingo experience that runs entirely in the browser, with no backend or data upload, and can be forked or customized by anyone.
Workflow
- Generate a seeded 4×4 card based on the current date and season
- Open the app and view the card once
- Take a photo of an item when found
- The browser loads the cached CLIP model and runs zero‑shot classification with target and distractor labels
- If the target is top or score ≥0.35, the square is marked
- Track progress in localStorage
- When four in a row are achieved, a text‑only summary can be shared
- The app works offline after the first visit via a service worker
Evidence
Tap a square, take a photo, and an open-weight CLIP model running in your browser checks whether the photo matches.
The checker is Xenova/clip-vit-base-patch32, an ONNX build of CLIP, loaded with Transformers.js.
Photos are read locally, resized in memory, scored on the device, and discarded. They are not uploaded, not stored in localStorage, and not included when you share.
The model downloads once and the browser caches it. A small service worker caches the app shell, so after the first visit it keeps working where you have no signal.
- Record date: 2026-10-10T07:40:55.445Z