by night-chen · AI 工具 · ★ 287
🛠️ToolQA 🛠️ The official repository for code and data of ToolQA dataset. ToolQA is a open-source dataset specifically designed for evaluations on tool-augmented large language models (LLMs). This repo provides the dataset, the corresponding data generation code, and the implementations of baselines on our dataset. Features Our questions are selected and guaranteed that LLMs have little chance to memorize and answer correctly within their internal knowledge; The majority of the questions in ToolQA require compositional use of multiple tools.
| Stars | 287 |
| Forks | 14 |
| Language | Jupyter Notebook |
| Category | AI 工具 |
| License | Apache-2.0 |
| Quality Score | 67.6839033158702/100 |
| Open Issues | 5 |
| Last Updated | 2023-08-19 |
| Created | 2023-06-06 |
| Est. Tokens | ~24k |
Explore other popular ai 工具 tools:
ToolQA is ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.. It is categorized as a AI 工具 with 287 GitHub stars.
ToolQA is primarily written in Jupyter Notebook. It covers topics such as large-language-models, natural-language-understanding, natural-lauguage-processing.
You can find installation instructions and usage details in the ToolQA GitHub repository at github.com/night-chen/ToolQA. The project has 287 stars and 14 forks, indicating an active community.
ToolQA is released under the Apache-2.0 license, making it free to use and modify according to the license terms.