Browser‑Based AI Models for Production Use

Описание и применение

Маленькие модели AI, работающие в браузере через Transformers.js, WebGPU и WebAssembly, позволяют реализовать практические функции, такие как удаление фона, генерация альтернативного текста, создание тикетов и семантический поиск, без обращения к внешним API, обеспечивая офлайн‑работу и сохранение конфиденциальности.

Задача

Can small AI models run directly in the browser be useful for real production applications?

Результат

Local browser inference delivered practical AI features with acceptable performance and privacy benefits, though model size limits and output consistency remain challenges.

Рабочий процесс

• 1. Set up a React/TypeScript app with Web Workers for inference.
• 2. Load models on demand via Transformers.js (e.g., RMBG‑1.4, Florence‑2‑base‑ft, Qwen2.5‑0.5B‑Instruct, all‑MiniLM‑L6‑v2).
• 3. Use WebGPU where supported, fallback to WebAssembly CPU execution.
• 4. Implement UI features: background remover, alt‑text generator, ticket creator, semantic search.
• 5. Validate structured outputs with schema validation (Zod).
• 6. Allow user review/edit before final use.

Доказательства

I wanted to find out how we could use browser-based AI today, right now, in real production applications.

Источник

The models are loaded on demand, so you don't need to download all five of them just to open the application.

Источник

RMBG‑1.4, with approximately 44 million parameters, does a really impressive job of separating an object from its background.

Источник

Florence‑2‑base‑ft, a vision model with approximately 230 million parameters, to generate descriptions of images.

Источник

Qwen2.5‑0.5B‑Instruct, a small language model with approximately 500 million parameters.

Источник

all‑MiniLM‑L6‑v2, a small embedding model with approximately 22 million parameters.

Источник