Author: vLLM Team
License: Apache 2.0
Summary: A high-throughput and memory-efficient inference and serving engine for LLMs
Can't find the visual you need? Build your own here
Downloads over time
Top versions
Downloads by Python version over time
Top contributors
Downloads by system over time
Related packages
Downloads by country
File types by installer
Package | Downloads | Stars |
---|---|---|
Package | Downloads 3.2M | Stars 8.1K |
Package | Downloads 2.7M | Stars 6.4K |
Package | Downloads 1.3M | Stars 1.4K |
Package | Downloads 842K | Stars 40 |
Package | Downloads 368K | Stars 0 |
Package | Downloads 347K | Stars 11K |
Package | Downloads 198K | Stars 60 |
Package | Downloads 190K | Stars 9.2K |
Package | Downloads 170K | Stars 4.8K |