Later — keep screenshotting, an open-weight model turns your screenshots into one-tap actions
Описание и применение
Приложение Later автоматически преобразует скриншоты, сделанные для дальнейшего действия, в одно‑клик‑действия, используя открытый весовой видоизменяющий модель Qwen 3.8 27B.
Задача
Users take screenshots to deal with later, but the screenshots pile up and nothing happens.
Результат
The app automatically turns screenshots into actionable items, reducing manual follow‑up and providing a daily digest of tasks.
Рабочий процесс
- Take a screenshot
- WorkManager job runs every ~15 min and finds new files in the Screenshots folder
- Each screenshot is resized to a 1600 px JPEG
- Screenshot is sent to a FastAPI backend on Render
- Backend runs Qwen 3.8 27B (open‑weights, vision) on Groq and returns JSON with kind, title, summary, date, time, location, amount, url
- The phone receives the JSON and creates a card with a one‑tap action (e.g., Add to calendar, Add reminder, Open in maps, Open link)
- At 8 PM a digest notification summarizes the day’s items
Доказательства
Everyone has a camera roll full of screenshots taken "to deal with later"
Later is an Android app that rewards exactly that habit. You keep screenshotting, and you don't even open the app.
Screenshot taken ──▶ WorkManager job (every ~15 min, even with the app closed) │ finds new files in the Screenshots folder (MediaStore) │ shrinks each one to a 1600 px JPEG ▼ FastAPI backend on Render ──▶ Qwen 3.8 27B (open weights, vision) on Groq │ {kind, title, summary, date, time, location, amount, url} ▼ Saved on the phone ──▶ one-tap actions + an 8 PM digest notification
Here's what the deployed server returned for a real test screenshot of an electricity bill, with today's date sent as Sunday 25 Oct: {"kind":"bill","title":"BSES Yamuna Power Bill","summary":"Pay the Rs. 1,240.00 electricity bill before the due date to avoid a late fee.","date":"2026-10-28","amount":"Rs. 1,240.00"}
- Дата записи: 2026-10-25T17:11:25.649Z