AirSketch

Описание и применение

Прототип AI‑доски, распознающей жесты и речь, генерирует структурированные заметки в реальном времени.

Задача

Students miss explanations while taking notes on a whiteboard.

Результат

Prototype demonstrated real‑time gesture control, speech transcription, and AI‑generated notes within a 24‑hour hackathon.

Рабочий процесс

• Capture webcam frames → Hand detection → Landmark tracking → Gesture interpretation → Digital canvas
• Capture microphone audio → Speech recognition → Transcript → AI model → Structured notes

Доказательства

We wanted to explore how computer vision, speech recognition, and generative AI could work together to create a more interactive learning experience.

Источник

Webcam → Hand Detection → Landmark Tracking → Gesture Interpretation → Digital Canvas

Источник

Microphone → Speech Recognition → Transcript → AI Processing → Structured Notes

Источник