waybarrios/vllm-mlx helps connect AI assistants to real tools and data through a standard protocol

Описание и применение

waybarrios/vllm-mlx: open-source проект в категориях MCP, AI/ML, Backend. Практическое применение: connect AI agents to tools; ship Model Context Protocol servers. Уровень готовности: подходит для прототипа или внутреннего workflow, перед production нужна ручная проверка.

Задача

waybarrios/vllm-mlx helps connect AI assistants to real tools and data through a standard protocol.

Результат

Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

Рабочий процесс

• connect AI agents to tools
• ship Model Context Protocol servers
• standardize integrations

Доказательства

OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.

Источник