vec-inf
Author Email: Marshall Wang <marshall.wang@vectorinstitute.ai>
Summary: Efficient LLM inference on Slurm clusters using vLLM.
Can't find the visual you need? Build your own here
Downloads over time
Top versions
Downloads by Python version over time
Downloads by system over time
Related packages
Downloads by country
File types by installer