mlx-llm

by riccardomusmeci · AI 工具 · ★ 459

About mlx-llm

mlx-llm Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX. Go to the entire Youtube Video. How to install 🔨 Models 🧠 Currently, out-of-the-box supported models are: To create a model with pre-trained weights from HuggingFace: You can also load a new version of pre-trained weights for a

llamallmmistralmlxphitransformers

Quick Facts

Stars459
Forks28
LanguagePython
CategoryAI 工具
Quality Score40.25/100
Last Updated2025-01-29
Created2023-12-07
Platformspython
Est. Tokens~127k

Compatible Skills

These tools work well together with mlx-llm for enhanced workflows:

  • vllm-mlx — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • universal-intelligence — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • BambooAI — semantic(0.15)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • coderunner — semantic(0.24)+complementary+same_lang+similar_pop+shared_platform (53%)
  • mxcp — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

More AI 工具 Tools

Explore other popular ai 工具 tools:

View all AI 工具 tools →

Popular Python Agent Tools

Frequently Asked Questions

What is mlx-llm?

mlx-llm is Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.. It is categorized as a AI 工具 with 459 GitHub stars.

What programming language is mlx-llm written in?

mlx-llm is primarily written in Python. It covers topics such as llama, llm, mistral.

How do I install or use mlx-llm?

You can find installation instructions and usage details in the mlx-llm GitHub repository at github.com/riccardomusmeci/mlx-llm. The project has 459 stars and 28 forks, indicating an active community.

View on GitHub → Browse AI 工具 tools