Author: vLLM Team
License: Apache 2.0
Summary: A high-throughput and memory-efficient inference and serving engine for LLMs
Can't find the visual you need? Build your own here
Downloads over time
Top versions
Downloads by Python version over time
Top contributors
Downloads by system over time
Related packages
Downloads by country
File types by installer
Package | Downloads | Stars |
---|---|---|
Package | Downloads 4M | Stars 8.9K |
Package | Downloads 3M | Stars 6.7K |
Package | Downloads 1.4M | Stars 1.7K |
Package | Downloads 948K | Stars 43 |
Package | Downloads 505K | Stars 11K |
Package | Downloads 396K | Stars 0 |
Package | Downloads 215K | Stars 65 |
Package | Downloads 213K | Stars 9.4K |
Package | Downloads 195K | Stars 5.2K |