gpt_server

About gpt_server

GPT Server [![License][license-shield]][license-url] [![Stars][stars-shield]][stars-url] [![Forks][forks-shield]][forks-url] [![Docker pulls][docker-pulls]][docker-pulls] [![CI Status][ci-shield]][ci-url] [![issue resolution][closed-issues-shield]][closed-issues-url] 本项目依托fastchat的基础能力来提供openai server的能力.

asr embedding fastchat function-calling gpt infinity llama llm lmdeploy openai

Quick Facts

Stars	253
Forks	23
Language	Python
Category	LLM 插件
License	Apache-2.0
Quality Score	65.1854709030341/100
Open Issues	3
Last Updated	2026-05-09
Created	2023-12-16
Platforms	python
Est. Tokens	~402k

Compatible Skills

These tools work well together with gpt_server for enhanced workflows:

voicemode — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)

More LLM 插件 Tools

Explore other popular llm 插件 tools:

promptfoo ⭐ 26.1k
needle ⭐ 14.1k
gorilla ⭐ 13.0k
PocketFlow-Tutorial-Codebase-Knowledge ⭐ 12.7k
llm ⭐ 12.6k
phoenix ⭐ 11.9k
llm-engineer-toolkit ⭐ 10.9k
code2prompt ⭐ 7.7k
DeepAudit ⭐ 7.1k
superagent ⭐ 6.7k

View all LLM 插件 tools →

Popular Python Agent Tools

hermes-agent ⭐ 255.2k · Codex 技能
AutoGPT ⭐ 187.7k · AI 工具
skills ⭐ 180.2k · Claude 技能
dify ⭐ 158.9k · MCP 服务器
open-webui ⭐ 156.2k · MCP 服务器

Frequently Asked Questions

What is gpt_server?

gpt_server is gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。. It is categorized as a LLM 插件 with 253 GitHub stars.

What programming language is gpt_server written in?

gpt_server is primarily written in Python. It covers topics such as asr, embedding, fastchat.

How do I install or use gpt_server?

You can find installation instructions and usage details in the gpt_server GitHub repository at github.com/shell-nlp/gpt_server. The project has 253 stars and 23 forks, indicating an active community.

What license does gpt_server use?

gpt_server is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse LLM 插件 tools