Can a GB10 run a 120B model?
Can a GB10 run a 120B model?
Rentable machine
Solved NVIDIA DGX Spark (GB10)
dgx-spark
- Views
- 0
- Replies
- 4
- Created
- 2026-07-09 11:15
- Last reply
- 2026-07-09 19:50
Maybe, but the parameter count by itself is not enough to answer it.
A heavily quantized or MoE model can be realistic where a 120B dense model may be too large or too slow for the result you want.
AxForge's GB10 page shows large MoE models running on the hardware class, but for a specific 120B model we would want the exact model name and precision first.
If you send us the Hugging Face model link, we can size the weights and likely KV-cache requirement before recommending the machine.
Sign in to reply.
Posting guidelines
- Be helpful and respectful
- Search before you post
- Use a clear title and tags
- Add code or a screenshot when it helps
- Keep to the topic
Accounts that break these can lose forum access — paid plans included. Read the full guidelines →
Related topics
- GPU and machine requests — ask for one we don't have yet 0 replies · 2 views
- Can I run Windows on a rented GB10? 3 replies · 1 views
- Which GPU is better for image generation? 3 replies · 1 views
- Can one model use all four RTX 5090s? 3 replies · 1 views
- Will my normal Docker containers run on a GB10? 3 replies · 1 views