From Arduino sketches to digital twins: where Sketch2Sim goes next, and how to get involved
Описание и применение
Sketch2Sim преобразует рисунок схемы в код для симулятора, используя модель Gemma 4 и валидатор. В статье описывается текущий функционал, дорожная карта расширения на ESP32, Raspberry Pi Pico, Arduino UNO Q и другие симуляторы, а также приглашение сообщества участвовать.
Задача
How to extend a vision‑to‑simulator pipeline from a single Arduino target to multiple hardware platforms and simulators, and how to involve the community.
Результат
Prototype demonstrates feasibility of converting sketches to simulator code; roadmap outlines concrete next steps and community involvement opportunities.
Рабочий процесс
- Photograph circuit sketch
- Gemma 4 reads intent
- Validator repairs and shows fixes
- Generate simulator‑specific output
Доказательства
Sketch2Sim does one narrow thing today. You photograph a circuit sketch, Gemma 4 reads it, a validator makes the result correct, and you get a project that runs in the Wokwi Arduino simulator.
It was tested on six sketches and verified in Wokwi on five circuits.
The engine is a few small TypeScript files with no dependencies beyond fetch, and a new board is mostly a catalog entry plus a few rules.
- Дата записи: 2026-11-01T16:28:51.691Z