by Maximilian-Winter · AI 工具 · ★ 652
llama-cpp-agent Not Longer Maintained. Use instead ToolAgents or other Python agentic frameworks. [] Introduction The llama-cpp-agent framework is a tool designed to simplify interactions with Large Language Models (LLMs). It provides an interface for chatting with LLMs, executing function calls, generating structured output, performing retrieval augmented generation, and processing text using agentic chains with tools. The framework uses guided sampling to constrain the model output to the user defined structures.
| Stars | 652 |
| Forks | 73 |
| Language | Python |
| Category | AI 工具 |
| Quality Score | 71.6139043472405/100 |
| Open Issues | 25 |
| Last Updated | 2026-03-09 |
| Created | 2023-12-29 |
| Platforms | python |
| Est. Tokens | ~383k |
These tools work well together with llama-cpp-agent for enhanced workflows:
Explore other popular ai 工具 tools:
llama-cpp-agent is The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured ou. It is categorized as a AI 工具 with 652 GitHub stars.
llama-cpp-agent is primarily written in Python. It covers topics such as agents, function-calling, llamacpp.
You can find installation instructions and usage details in the llama-cpp-agent GitHub repository at github.com/Maximilian-Winter/llama-cpp-agent. The project has 652 stars and 73 forks, indicating an active community.