Foliage Hunter: a Colorado leaf guide on a fine-tuned Gemma 3, built to keep the screen short

Описание и применение

Приложение Foliage Hunter позволяет быстро идентифицировать листья осенних деревьев в Колорадо, используя модель Gemma 3 и TTS Magpie, при этом пользователь не останавливается для чтения.

Задача

Users on the Front Range want to identify fall foliage quickly without stopping to read.

Результат

The app enabled a ten‑minute field test in Castle Rock, Colorado, successfully identifying six species and recording geocoded finds. The initial HEIC‑to‑JPEG conversion fix reduced payloads and resolved 500 errors.

Рабочий процесс

• 1. Walk and find a leaf
• 2. Tap to capture photo
• 3. Model identifies the tree and generates a short spoken description
• 4. TTS speaks the description while the photo is processed
• 5. The find is pinned to a trail view showing all previous finds

Доказательства

Foliage Hunter is a pocket leaf guide for peeping fantastic fall foliage. You walk, you find a leaf, you snap it.

Источник

The loop is deliberately short. One tap to shoot, a few seconds of a leaf wreath spinning, and the guide starts talking before the whole reply has even been synthesized.

Источник

The fix was to re‑encode on the phone with expo-image-manipulator (resize to 1280 px, JPEG at 0.82) before upload, which also cut the payload to a fraction of the original.

Источник

The app runs in Expo Go on your phone and talks to a model you host.

Источник