vllm-project/vllm
88.6kStar
20.5kFork
+85今日 Star
Python语言
Star 趋势
项目介绍与用途
「vllm-project/vllm」是由 vllm-project 维护、主要使用 Python 开发的开源项目。A high-throughput and memory-efficient inference and serving engine for LLMs。目前该项目在 GitHub 上累计获得 88.6k 个 Star、20.5k 次 Fork(今日新增 85 Star)。如果你关注 Python 方向的开源生态,它值得收藏、学习与参考。
项目简介
A high-throughput and memory-efficient inference and serving engine for LLMs
相关项目
antirez/ds4DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
DataExpert-io/data-engineer-handbookThis is a repo with links to everything you'd ever want to learn about data engineering
malisper/pgrustPostgres rewritten in Rust, now faster than Postgres and Clickhouse
cloud-hypervisor/cloud-hypervisorA Virtual Machine Monitor for modern Cloud workloads. Features include CPU, memory and device hotplug, support for running Windows and Linux guests, device offload with vhost-user and a minimal compact footprint. Written in Rust with a strong focus on security.
drawdb-io/drawdbFree, simple, and intuitive online database diagram editor and SQL generator.
apache/flussApache Fluss is a streaming storage built for real-time analytics.