mlx-serve

by ddalcu · AI 工具 · ★ 1.2k

About mlx-serve

mlx-serve — run any LLM on your Mac OpenAI- and Anthropic-compatible local inference for Apple Silicon — MLX and GGUF — faster than LM Studio on the same file. No Python. No cloud. No Electron. ddalcu.github.io/mlx-serve · Download MLX Core.app · Changelog ★ If mlx-serve saves you from spinning up another Electron app, star the repo — it genuinely helps people fin

agentanthropic-apiapple-siliconclaude-codedeepseek-v4diffusionggufimage-generationinferencellm

Quick Facts

Stars1,170
Forks104
LanguageZig
CategoryAI 工具
Quality Score71.1837400706557/100
Open Issues48
Last Updated2026-09-09
Created2026-02-17
Platformsclaude-code
Est. Tokens~23k

More AI 工具 Tools

Explore other popular ai 工具 tools:

View all AI 工具 tools →

Popular Zig Agent Tools

Frequently Asked Questions

What is mlx-serve?

mlx-serve is Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.. It is categorized as a AI 工具 with 1.2k GitHub stars.

What programming language is mlx-serve written in?

mlx-serve is primarily written in Zig. It covers topics such as agent, anthropic-api, apple-silicon.

How do I install or use mlx-serve?

You can find installation instructions and usage details in the mlx-serve GitHub repository at github.com/ddalcu/mlx-serve. The project has 1.2k stars and 104 forks, indicating an active community.

View on GitHub → Browse AI 工具 tools