vllm-project/vllm
93.4kStar
23.1kFork
+67今日 Star
Python语言
Star 趋势
项目介绍与用途
「vllm-project/vllm」是由 vllm-project 维护、主要使用 Python 开发的开源项目。A high-throughput and memory-efficient inference and serving engine for LLMs。目前该项目在 GitHub 上累计获得 93.4k 个 Star、23.1k 次 Fork（今日新增 67 Star）。如果你关注 Python 方向的开源生态，它值得收藏、学习与参考。
项目简介
A high-throughput and memory-efficient inference and serving engine for LLMs
相关项目
EpicGames/raddebuggerA native, user-mode, multi-process, graphical debugger.
trycua/cuaScale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.
tile-ai/tilelangDomain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
JustVugg/colibriRun frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
nodejs/nodeNode.js JavaScript runtime ✨🐢🚀✨
MiaAI-Lab/sparkDashsparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard