llama-cpp-agent

by Maximilian-Winter · AI 工具 · ★ 620

About llama-cpp-agent

llama-cpp-agent Not Longer Maintained. Use instead ToolAgents or other Python agentic frameworks. [] Introduction The llama-cpp-agent framework is a tool designed to simplify interactions with Large Language Models (LLMs). It provides an interface for chatting with LLMs, executing function calls, generating structured output, performing retrieval augmented generation, and processing text using agentic chains with tools. The framework uses guided sampling to constrain the model output to the user defined structures.

agentsfunction-callingllamacppllmllm-agentllm-frameworkllmsparallel-function-call

Quick Facts

Stars620
Forks69
LanguagePython
CategoryAI 工具
Quality Score41.75/100
Open Issues24
Last Updated2026-03-09
Created2023-12-29
Platformspython
Est. Tokens~383k

Compatible Skills

These tools work well together with llama-cpp-agent for enhanced workflows:

  • SimplerLLM — semantic(0.30)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • SimpleLLMFunc — semantic(0.28)+complementary+rare_topics+same_lang+similar_pop+shared_platform (59%)
  • LLMCompiler — semantic(0.51)+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • Agently — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • ai-microcore — semantic(0.19)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)

More AI 工具 Tools

Explore other popular ai 工具 tools:

View all AI 工具 tools →

Popular Python Agent Tools

Frequently Asked Questions

What is llama-cpp-agent?

llama-cpp-agent is The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured ou. It is categorized as a AI 工具 with 620 GitHub stars.

What programming language is llama-cpp-agent written in?

llama-cpp-agent is primarily written in Python. It covers topics such as agents, function-calling, llamacpp.

How do I install or use llama-cpp-agent?

You can find installation instructions and usage details in the llama-cpp-agent GitHub repository at github.com/Maximilian-Winter/llama-cpp-agent. The project has 620 stars and 69 forks, indicating an active community.

View on GitHub → Browse AI 工具 tools