87+ open-source llm 插件 tools ranked by stars
LLM 插件 tools are open-source packages that extend AI coding agents like Claude Code, OpenAI Codex, Gemini CLI, and other AI assistants. They provide specialized capabilities ranging from code generation and debugging to API integration and workflow automation.
万物皆可skills indexes 87+ llm 插件 tools from GitHub, ranked by community adoption (stars), code quality scores, and compatibility with popular AI agents. The top languages in this category are TypeScript, Python, Rust, Swift, Zig.
| # | Skill | Stars | Lang |
|---|---|---|---|
| 1 | promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare p |
★ 26.1k | TypeScript |
| 2 | needle Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction |
★ 14.1k | Python |
| 3 | gorilla Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls) |
★ 13.0k | Python |
| 4 | PocketFlow-Tutorial-Codebase-Knowledge Pocket Flow: Codebase to Tutorial |
★ 12.7k | Python |
| 5 | llm Access large language models from the command-line |
★ 12.6k | Python |
| 6 | phoenix AI Observability & Evaluation |
★ 11.9k | Python |
| 7 | llm-engineer-toolkit A curated list of 120+ LLM libraries category wise. |
★ 10.9k | |
| 8 | code2prompt A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, an |
★ 7.7k | Rust |
| 9 | DeepAudit DeepAudit：人人拥有的 AI 黑客战队，让漏洞挖掘触手可及。国内首个开源的代码漏洞挖掘多智能体系统。小白一键部署运行，自主协作审计 + 自动化沙箱 PoC 验证。支持 Ollama 私有部署 |
★ 7.1k | Python |
| 10 | superagent Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. |
★ 6.7k | TypeScript |
| 11 | ai-cookbook Examples and tutorials to help developers build AI systems |
★ 4.6k | Python |
| 12 | DecryptPrompt 总结Prompt&LLM论文，开源数据&模型，AIGC应用 |
★ 3.4k | |
| 13 | awesome-local-llm A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally |
★ 3.0k | |
| 14 | ax The pretty much "official" DSPy framework for Typescript |
★ 3.0k | TypeScript |
| 15 | yek A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumptio |
★ 2.5k | Rust |
| 16 | code-interpreter Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app |
★ 2.4k | Python |
| 17 | WritingTools The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writi |
★ 2.4k | Swift |
| 18 | awesome-jev A curated list of public projects, integrations, and discussions built on Jev — TypeSafe AI's System |
★ 2.4k | Python |
| 19 | tau2-bench τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains |
★ 2.2k | Python |
| 20 | any-llm Communicate with an LLM provider using a single interface |
★ 2.2k | Python |
| 21 | obsidian-textgenerator-plugin Text Generator is a versatile plugin for Obsidian that allows you to generate text content using var |
★ 2.0k | TypeScript |
| 22 | repo2txt Web-based tool converts GitHub repository contents into a single formatted text file |
★ 1.8k | TypeScript |
| 23 | BruteForceAI Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks |
★ 1.7k | Python |
| 24 | awesome-llm-agents A curated list of awesome LLM agents frameworks. |
★ 1.6k | Python |
| 25 | ExtractThinker ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexi |
★ 1.6k | Python |
| 26 | desktop E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to |
★ 1.5k | Python |
| 27 | mirascope The LLM Anti-Framework |
★ 1.5k | Python |
| 28 | AnyJev Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (con |
★ 1.4k | Python |
| 29 | spacy-llm 🦙 Integrating LLMs into structured NLP pipelines |
★ 1.4k | Python |
| 30 | TensorFold LLM Inference Engine for Metal and CUDA. |
★ 1.4k | Zig |
| 31 | langtrace Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applicat |
★ 1.2k | TypeScript |
| 32 | LLM-ToolMaker |
★ 1.1k | Jupyter Notebook |
| 33 | ontogpt LLM-based ontological extraction tools, including SPIRES |
★ 1.0k | Jupyter Notebook |
| 34 | NyaProxy NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI |
★ 976 | Python |
| 35 | laya Run Laya, the open-source Jev-compatible System-1 decision model, from Node.js / TypeScript via ONNX |
★ 964 | TypeScript |
| 36 | TypeLLM TypeLLM: LLMs with type-safe generation |
★ 962 | Python |
| 37 | code2prompt Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Larg |
★ 882 | Python |
| 38 | obsidian-llm-wiki-local Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsid |
★ 834 | Python |
| 39 | jev-chat-windows JevChat-Windows：聊天窗口旁挂的回复辅助。窗口截图 + 本地离线 OCR 读对方消息 → Jev 判断意图 → 3 条候选一键填入，发送永远手动 |
★ 825 | Python |
| 40 | awesome-jev-tools A curated list of tools built for Jev — TypeSafe AI's System One model for typed decisions. |
★ 752 | |
| 41 | otari Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with vi |
★ 691 | Python |
| 42 | kani kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 202 |
★ 607 | Python |
| 43 | Atria-Dawn |
★ 607 | |
| 44 | tessera From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels |
★ 579 | Python |
| 45 | Atria-Dawn-Preview |
★ 567 | |
| 46 | echo The User Pays AI SDK |
★ 542 | TypeScript |
| 47 | awesome-jev-gallery 🔥🔥 Awesome Jev: open-source models, projects, benchmarks, and independent evaluations for Jev and |
★ 508 | Python |
| 48 | vllm-cli A command-line interface tool for serving LLM using vLLM. |
★ 505 | Python |
| 49 | jev-chat-jarvis-mac 聊天悬浮窗助手（macOS）：屏幕感知 + 本地小模型判断意图与风险，按话术生成回复候选。纯只读。 |
★ 504 | Python |
| 50 | LLM-Tool-Survey This is the repository for the Tool Learning survey. |
★ 489 | |
| 51 | ToolNeuron On-device AI for Android — LLM chat (GGUF/llama.cpp), vision models (VLM), image generation (Stable |
★ 473 | Kotlin |
| 52 | LLM2Jev Turn local language models into Jev-style structured decision models. Get results from text and imag |
★ 452 | Python |
| 53 | JevRev An LLM + Jev workflow that changes EVERYTHING. Boost your vertebrate brain with a spine inside. |
★ 446 | TypeScript |
| 54 | OpenRCA [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures? |
★ 434 | Python |
| 55 | neuroarxiv A skill to kill from-scratch coding — Claude checks real arXiv prior art before it designs a new arc |
★ 423 | TypeScript |
| 56 | predikit pypi-predikit: Turn any sklearn/XGBoost model into an LLM-callable tool. Framework-agnostic |
★ 417 | Python |
| 57 | chatgpt-subtitle-translator Token efficient translation tool based on ChatGPT or any OpenAI compatible LLM chat completion API |
★ 390 | JavaScript |
| 58 | claude-code-trace Claude Code session log viewer for JSONL files in ~/.claude/projects. Browse conversations, tool cal |
★ 376 | Rust |
| 59 | genai-code-review GitHub Action that reviews pull request diffs with an LLM and posts the comments on the PR |
★ 371 | Python |
| 60 | create-llm The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready P |
★ 362 | TypeScript |
| 61 | toolkit.dev Get paid to build LLM tools |
★ 357 | TypeScript |
| 62 | ResumeForge 简历通 ResumeForge —— 本地优先的 AI 简历工作台：岗位管理、事实台账防虚构、AI 定制/手写简历、多格式导出、模拟面试与面试深挖、自动投递台、求职进度与数据看板。FastAPI + |
★ 334 | Python |
| 63 | openjev-sglang Jev-compatible API endpoint based on open models (prefill-only) |
★ 333 | Python |
| 64 | llms-tools A list of LLMs Tools & Projects |
★ 329 | |
| 65 | leanctx Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your |
★ 317 | Python |
| 66 | openai-function-calling-tools 🛠 openai function calling tools for JS/TS |
★ 313 | TypeScript |
| 67 | input0 Input0 — A macOS voice input tool: hold a hotkey to record, release to transcribe locally via STT, r |
★ 302 | Rust |
| 68 | apicat An efficient API documentation management tool that fully adheres to the OpenAPI specification and i |
★ 289 | Go |
| 69 | bocoel Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) tha |
★ 289 | Python |
| 70 | SecGPT A Test Project for a Network Security-oriented LLM Tool Emulating AutoGPT |
★ 287 | Python |
| 71 | jev4pg Established strong JEV based natural language to SQL performance and well-covered semantic operators |
★ 279 | Python |
| 72 | resume-job-matcher TypeScript CLI for AI resume screening: hard constraints gate candidates out before scoring, every s |
★ 268 | TypeScript |
| 73 | codinit-dev Local-First Open Source web & mobile AI app builder — install on MacOS, Windows & Linux |
★ 266 | TypeScript |
| 74 | synto More than just Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concep |
★ 261 | Python |
| 75 | gpt_server gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。 |
★ 253 | Python |
| 76 | marginalia A library-science-inspired personal knowledge management system with LLM agents |
★ 247 | Python |
| 77 | GermanWordEmbeddings Toolkit to obtain and preprocess German text corpora, train models and evaluate them with generated |
★ 245 | Jupyter Notebook |
| 78 | llm-rl-environments-lil-course 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Model |
★ 235 | Python |
| 79 | github-pr-summary Use LLM to summarize & review GitHub Pull Requests |
★ 230 | Rust |
| 80 | J-Wash Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian |
★ 228 | Python |
| 81 | frugon Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine. |
★ 216 | Python |
| 82 | cognidb CogniDB is a Python-powered Natural Language to SQL interface that enables users to query databases |
★ 216 | Python |
| 83 | llm_intents Exposes internet search tools for use by LLM-backed Assist in Home Assistant |
★ 215 | Python |
| 84 | Eridanus 基于 OneBot 协议的多功能bot兼开发框架。以llm function calling为核心构建了更智能的功能调用机制。支持不接入QQ纯Live2d桌宠模式 |
★ 208 | Python |
| 85 | Awesome-Multi-Token-Prediction A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related technique |
★ 205 | |
| 86 | cai User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! |
★ 203 | Rust |
| 87 | runtime Deterministic skills-based browser agent |
★ 203 | TypeScript |