feat: Auto unload model if vLLM health check failed#73
Merged
kthui merged 18 commits intomainfrom jacky-vllm-healthDec 5, 2024
+399-12
Commits
Commits on Nov 19, 2024
- committed
- committed
- committed
Commits on Nov 21, 2024
Commits on Nov 22, 2024
Commits on Nov 26, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed