You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: site-src/guides/index.md
-2
Original file line number
Diff line number
Diff line change
@@ -34,10 +34,8 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
34
34
35
35
#### CPU-Based Model Server
36
36
37
-
Create a Hugging Face secret to download the model [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct). Ensure that the token grants access to this model.
38
37
Deploy a sample vLLM deployment with the proper protocol to work with the LLM Instance Gateway.
39
38
```bash
40
-
kubectl create secret generic hf-token --from-literal=token=$HF_TOKEN# Your Hugging Face Token with access to Qwen
0 commit comments