I built a one-click installer for local LLMs on Windows: it picks a model for your hardware and sets up Ollama

说明与用途

Local AI 是一个 Windows 应用程序，自动检测硬件，推荐合适的 LLM 模型，安装 Ollama 和模型，并通过单击打开聊天界面。

问题

Setting up a local LLM on Windows requires installing Ollama, selecting a suitable model for the hardware, downloading large files, and configuring a UI, which is cumbersome for new users.

结果

Local AI reduces the initial setup of a local LLM on Windows to a single click, automatically selecting a model that fits the hardware and providing a ready‑to‑use chat interface.

工作流

• Run LocalAI.exe
• Detect GPU, VRAM, RAM, and free disk space
• Recommend a model from a catalogue of 34 models based on hardware
• Download and install Ollama (resumable, signature‑checked)
• Pull the recommended model with progress
• Launch chat UI with streaming replies, attachments, and model info
• Optionally move models, update, or uninstall

证据

Running an LLM locally is not hard, but the first time is a small quest: install Ollama, figure out which of a hundred models fits your GPU, get the tag right, wait for gigabytes to download, find a UI.

来源

Local AI: a free, open-source (MIT) Windows app that looks at your hardware, picks a model, installs Ollama and the model, and opens a chat.

来源

Detects the GPU, VRAM, RAM and free disk space, and recommends a model from a catalogue of 34

来源

Downloads and installs Ollama without administrator rights, then pulls the model with progress.

来源

Conversations never leave the PC: the chat talks to Ollama on 127.0.0.1.

来源

It is Python plus pywebview (WebView2). main.py starts a local HTTP server on 127.0.0.1 and opens the window; the UI is plain HTML/CSS/JS with no build step.

来源