-
Trending
AI 速览
基于 PagedAttention 的高吞吐 LLM Serving 引擎
★ 94,463
Python
Apache-2.0
#amd#blackwell#cuda#deepseek
GitHub ↗
-
Trending
AI 速览
统一100+ LLM接口的开源AI网关与SDK
★ 60,696
Python
NOASSERTION
#ai-gateway#anthropic#azure-openai#bedrock
GitHub ↗
-
Trending
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.