AirSketch

说明与用途

一个 AI 驱动的白板原型，识别手势和语音，实时生成结构化笔记。

问题

Students miss explanations while taking notes on a whiteboard.

结果

Prototype demonstrated real‑time gesture control, speech transcription, and AI‑generated notes within a 24‑hour hackathon.

工作流

• Capture webcam frames → Hand detection → Landmark tracking → Gesture interpretation → Digital canvas
• Capture microphone audio → Speech recognition → Transcript → AI model → Structured notes

证据

We wanted to explore how computer vision, speech recognition, and generative AI could work together to create a more interactive learning experience.

来源

Webcam → Hand Detection → Landmark Tracking → Gesture Interpretation → Digital Canvas

来源

Microphone → Speech Recognition → Transcript → AI Processing → Structured Notes

来源