InferrLM

by sbhjt-gr · AI 工具 · ★ 92

About InferrLM

InferrLM (Previously Inferra) InferrLM is a mobile application that brings LLMs & SLMs directly to your Android & iOS device and lets your device act as a local server. Cloud-based models like Claude, Gemini and ChatGPT are also supported. File attachments with RAG are also well-supported for local models. If you want to support me and the development of this project, you can donate to me through Ko-fi. Demo Demos of using the Apple Foundation Model and downloading MLX models from HuggingFace and running them on-device. <img src="assets/demo1.gif" alt="Demo 1" h

anthropicdocument-processingedge-aiembeddingsgeminiggufhttp-serverllama-cppllamacpplocal-inference

Quick Facts

Stars92
Forks24
LanguageTypeScript
CategoryAI 工具
LicenseAGPL-3.0
Quality Score30.25/100
Open Issues3
Last Updated2026-06-01
Created2025-02-09
Platformsgemini, node
Est. Tokens~15006k

Compatible Skills

These tools work well together with InferrLM for enhanced workflows:

  • nutrient-document-engine-mcp-server — semantic(0.19)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • local-cocoa — semantic(0.18)+complementary+same_lang+similar_pop+shared_platform (51%)
  • ai-agent-session-center — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (51%)
  • AgentRunKit — semantic(0.28)+complementary+rare_topics+similar_pop (49%)
  • luna-agent — semantic(0.17)+complementary+rare_topics+similar_pop (45%)

More AI 工具 Tools

Explore other popular ai 工具 tools:

View all AI 工具 tools →

Popular TypeScript Agent Tools

  • openclaw ⭐ 379.1k · Codex 技能
  • n8n ⭐ 192.9k · MCP 服务器
  • dify ⭐ 145.6k · MCP 服务器
  • gstack ⭐ 110.8k · AI 工具
  • gemini-cli ⭐ 105.3k · MCP 服务器

Frequently Asked Questions

What is InferrLM?

InferrLM is InferrLM - On-device AI for iOS & Android. It is categorized as a AI 工具 with 92 GitHub stars.

What programming language is InferrLM written in?

InferrLM is primarily written in TypeScript. It covers topics such as anthropic, document-processing, edge-ai.

How do I install or use InferrLM?

You can find installation instructions and usage details in the InferrLM GitHub repository at github.com/sbhjt-gr/InferrLM. The project has 92 stars and 24 forks, indicating an active community.

What license does InferrLM use?

InferrLM is released under the AGPL-3.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse AI 工具 tools