Snarf/homelab-gitops
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add Kubernetes manifests for AI stack deployment including Qdrant, vLLM, and Triton

Browse Source
This commit is contained in:
Snarf
2026-11-08 14:17:27 -05:00
parent ed38845802
commit a7c636cac0
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
manifests/spacedock/ai-stack/ai-stack.yaml
View File

@@ -136,7 +136,7 @@ spec:
- "--served-model-name" - "--served-model-name"
- "Qwen2.5-7B-Instruct" - "Qwen2.5-7B-Instruct"
- "--quantization" - "--quantization"
- "awq_marlin" - "awq"
- "--dtype" - "--dtype"
- "half" - "half"
- "--max-model-len" - "--max-model-len"