Can I run vLLM on the GB10?
Can I run vLLM on the GB10?
Rentable machine
Solved NVIDIA DGX Spark (GB10)
dgx-spark
- Views
- 0
- Replies
- 2
- Created
- 2026-06-30 11:30
- Last reply
- 2026-06-30 15:30
Yes, AxForge explicitly lists self-managed serving stacks such as vLLM as a GB10 use case.
You still need an ARM64-compatible setup and a vLLM/model combination that supports the hardware and quantization you want.
Sign in to reply.
Posting guidelines
- Be helpful and respectful
- Search before you post
- Use a clear title and tags
- Add code or a screenshot when it helps
- Keep to the topic
Accounts that break these can lose forum access — paid plans included. Read the full guidelines →
Related topics
- GPU and machine requests — ask for one we don't have yet 0 replies · 2 views
- Can I run Windows on a rented GB10? 3 replies · 1 views
- Which GPU is better for image generation? 3 replies · 1 views
- Can one model use all four RTX 5090s? 3 replies · 1 views
- Will my normal Docker containers run on a GB10? 3 replies · 1 views