From Arduino sketches to digital twins: where Sketch2Sim goes next, and how to get involved

Description and use

Sketch2Sim turns a circuit sketch into simulator code using Gemma 4 and a validator. The article outlines current capabilities, a roadmap to add ESP32, Raspberry Pi Pico, Arduino UNO Q, more parts, classroom mode, and other simulators, and invites community involvement.

Problem

How to extend a vision‑to‑simulator pipeline from a single Arduino target to multiple hardware platforms and simulators, and how to involve the community.

Outcome

Prototype demonstrates feasibility of converting sketches to simulator code; roadmap outlines concrete next steps and community involvement opportunities.

Workflow

• Photograph circuit sketch
• Gemma 4 reads intent
• Validator repairs and shows fixes
• Generate simulator‑specific output

Evidence

Sketch2Sim does one narrow thing today. You photograph a circuit sketch, Gemma 4 reads it, a validator makes the result correct, and you get a project that runs in the Wokwi Arduino simulator.

Source

It was tested on six sketches and verified in Wokwi on five circuits.

Source

The engine is a few small TypeScript files with no dependencies beyond fetch, and a new board is mostly a catalog entry plus a few rules.

Source