llm_context_benchmarks

by ivanfioravanti · LLM 插件 · ★ 67

About llm_context_benchmarks

LLM Context Benchmarks Benchmark prompt-processing and generation throughput across context sizes (0.5k–128k tokens) for many inference engines: Ollama (API & CLI), MLX, MLX Distributed, MLX-VLM, llama.cpp, LM Studio, Exo, Apple Foundation Models Serve, vMLX, oMLX, Paroquant, and any OpenAI-compatible endpoint. Optimized for Apple Silicon but works anywhere Python runs.

aibenchmarkingllms

Quick Facts

Stars67
Forks9
LanguagePython
CategoryLLM 插件
LicenseApache-2.0
Quality Score55.668/100
Open Issues4
Last Updated2026-06-13
Created2025-08-06
Platformscli, python
Est. Tokens~15k

More LLM 插件 Tools

Explore other popular llm 插件 tools:

View all LLM 插件 tools →

Popular Python Agent Tools

Frequently Asked Questions

What is llm_context_benchmarks?

llm_context_benchmarks is 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual benchmark modes (API/CLI), automatic hardware detection (optimized. It is categorized as a LLM 插件 with 67 GitHub stars.

What programming language is llm_context_benchmarks written in?

llm_context_benchmarks is primarily written in Python. It covers topics such as ai, benchmarking, llms.

How do I install or use llm_context_benchmarks?

You can find installation instructions and usage details in the llm_context_benchmarks GitHub repository at github.com/ivanfioravanti/llm_context_benchmarks. The project has 67 stars and 9 forks, indicating an active community.

What license does llm_context_benchmarks use?

llm_context_benchmarks is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse LLM 插件 tools