anna/Vllm-Setup-And-Model-Access
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
This repo contains docker compose file to load different LLMs with vllm and explains how to use them
1 Commit 1 Branch 0 Tags 28 KiB
434a7e0f29
Go to file
anna 434a7e0f29 add docker compose for qwen 5b
2025-04-18 14:44:07 +02:00
docker-compose-qwen.yml add docker compose for qwen 5b 2025-04-18 14:44:07 +02:00