Smart Proxy Tagger: An Offline Video Footage Tagger for Videographers

Description and use

Smart Proxy Tagger lets videographers index and search raw footage locally, avoiding cloud uploads, using Temporal, TimescaleDB with pgvector, and a local PaliGemma model.

Problem

Freelance editors struggle to locate moments in large collections of raw footage while keeping client media on the laptop and avoiding cloud uploads.

Outcome

The tool enables offline indexing and search of raw video footage, preserving client confidentiality and eliminating cloud costs, while providing a simple UI and voice notification upon completion.

Workflow

• Paste full path into UI
• Click "Index footage" to start Temporal workflow
• Temporal workflow samples frames every 5 seconds
• Local model captions each frame
• Embeddings are stored in TimescaleDB with pgvector
• Search UI queries the database for keyword or vector similarity
• ElevenLabs speaks a completion sentence
• Results displayed locally

Evidence

Freelance editors get a card full of interviews, B-roll, and one moment they cannot find.

Source

The only outbound media call is one spoken sentence when the index is finished, and that sentence never includes a frame or a file path.

Source

The indexer is built so a local open-weight model reads each sampled frame.

Source

Search rows live in TimescaleDB with pgvector, published on localhost.

Source