Browser‑Based AI Models for Production Use

说明与用途

基于浏览器的 AI 模型可用于生产环境，例如背景移除、生成替代文本、结构化工单创建和语义搜索。它们通过 WebGPU/WebAssembly 本地运行，避免外部 API，保护用户隐私。

问题

Can small AI models run directly in the browser be useful for real production applications?

结果

Browser‑based AI can deliver practical, privacy‑preserving features in production, especially for e‑commerce, accessibility, and support workflows, though large models remain impractical and licensing must be checked.

工作流

• 1. Set up a React + TypeScript app with Web Workers for inference.
• 2. Load models on demand via Transformers.js (e.g., RMBG‑1.4, Florence‑2‑base‑ft, Qwen2.5‑0.5B‑Instruct, all‑MiniLM‑L6‑v2).
• 3. Execute inference using WebGPU where available, fallback to WebAssembly CPU.
• 4. Provide UI for each feature (e.g., upload image → background removal, generate alt text, describe issue → structured ticket, search tickets).
• 5. Validate structured outputs with schema validation (Zod).
• 6. Allow user review/edit before final use.

证据

I wanted to focus on practical applications. More specifically, I wanted to find out how we could use browser-based AI today, right now, in real production applications.

来源

The models are loaded on demand, so you don't need to download all five of them just to open the application.

来源

RMBG‑1.4, with approximately 44 million parameters, does a really impressive job of separating an object from its background.

来源

Florence‑2‑base‑ft, a vision model with approximately 230 million parameters, to generate descriptions of images.

来源

Qwen2.5‑0.5B‑Instruct, a small language model with approximately 500 million parameters.

来源

all‑MiniLM‑L6‑v2, a small embedding model with approximately 22 million parameters.

来源

The application searches for tickets with a similar meaning. And, of course, I also included a traditional keyword search so you can compare the results yourself.

来源