SafePlate: a menu checker for my friend with a peanut allergy, built on Gemma

说明与用途

SafePlate 自动根据菜单中的过敏原对菜品进行分类，提供具体的询问问题并朗读提示，降低过敏风险。

问题

Akshitha has a severe peanut, tree nut, and shellfish allergy and repeatedly experiences allergic reactions when eating out because allergens are hidden in menu items.

结果

SafePlate processes a menu photo in about 13 seconds on a laptop, classifying dishes with high accuracy and providing actionable server questions. The safety net ensures no allergen keyword is missed, preventing false safe verdicts.

工作流

• 1. Take a photo of the menu with a phone or laptop camera.
• 2. Upload the photo to the SafePlate web page.
• 3. Gemma 3 (4B) processes the image locally via Ollama, returning structured JSON with verdict, reason, and ask_server fields.
• 4. A keyword safety net scans dish text for allergen keywords and forces an 'avoid' verdict if any are found.
• 5. The UI displays each dish with color-coded verdicts and the exact question to ask the server.
• 6. Optionally, tap the microphone icon to hear the verdicts spoken aloud.

证据

SafePlate tells your friend which dishes to avoid, which to ask about, and which look safe for their allergies.

来源

Gemma reads the menu photo itself and I don't need a separate OCR step.

来源

A safety net that doesn't trust the model. This is the part I care about most.

来源