ToolBench Recent studies on software tool manipulation with large language models (LLMs) mostly rely on closed model APIs (e.g. OpenAI), as there is an significant gap of model accuracy between those closed models and all the rest open-source LLMs. To study the root cause of the gap and further facilitate the development of open-source LLMs, especially their capabilities on tool manipulation, we create the ToolBench. The ToolBench is a benchmark consisting of diverse software tools for real-world tasks.
| Stars | 172 |
| Forks | 11 |
| Language | Python |
| Category | LLM 插件 |
| License | Apache-2.0 |
| Quality Score | 37.2/100 |
| Open Issues | 1 |
| Last Updated | 2024-02-28 |
| Created | 2023-05-19 |
| Platforms | python |
| Est. Tokens | ~50k |
Explore other popular llm 插件 tools:
toolbench is ToolBench, an evaluation suite for LLM tool manipulation capabilities.. It is categorized as a LLM 插件 with 172 GitHub stars.
toolbench is primarily written in Python.
You can find installation instructions and usage details in the toolbench GitHub repository at github.com/sambanova/toolbench. The project has 172 stars and 11 forks, indicating an active community.
toolbench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.