LLMinator: Run & Test LLMs directly from HuggingFace Gradio based tool with integrated chatbot to locally run & test LLMs directly from HuggingFace. An easy-to-use tool made with Gradio, LangChain, and Torch. ⚡ Features Context-aware Streaming Chatbot. Inbuilt code syntax highlighting. Load any LLM repo directly from HuggingFace. Supports both CPU & CUDA modes.
| Stars | 97 |
| Forks | 19 |
| Language | Python |
| Category | AI 工具 |
| License | MIT |
| Quality Score | 39.75/100 |
| Last Updated | 2024-06-27 |
| Created | 2024-03-28 |
| Platforms | browser, python |
| Est. Tokens | ~5k |
Explore other popular ai 工具 tools:
LLMinator is Gradio based tool to run opensource LLM models directly from Huggingface. It is categorized as a AI 工具 with 97 GitHub stars.
LLMinator is primarily written in Python. It covers topics such as chatbot, cpu, cuda.
You can find installation instructions and usage details in the LLMinator GitHub repository at github.com/Aesthisia/LLMinator. The project has 97 stars and 19 forks, indicating an active community.
LLMinator is released under the MIT license, making it free to use and modify according to the license terms.