Can I run a huge MoE model on a GB10?
Can I run a huge MoE model on a GB10?
Rentable machine
Solved NVIDIA DGX Spark (GB10)
dgx-spark
- Views
- 0
- Replies
- 3
- Created
- 2026-08-09 11:00
- Last reply
- 2026-08-09 17:27
Possibly. MoE models can be much larger on paper than the number of parameters actually used for each token.
That is one of the more interesting GB10 use cases: the 128 GB pool can hold large quantized weights, while only a subset of experts are active during generation.
The exact answer still depends on the model, quantization and serving engine. AxForge lists community GB10 results for MoE models well above 100B total parameters.
Sign in to reply.
Posting guidelines
- Be helpful and respectful
- Search before you post
- Use a clear title and tags
- Add code or a screenshot when it helps
- Keep to the topic
Accounts that break these can lose forum access — paid plans included. Read the full guidelines →
Related topics
- GPU and machine requests — ask for one we don't have yet 0 replies · 2 views
- Can I run Windows on a rented GB10? 3 replies · 1 views
- Which GPU is better for image generation? 3 replies · 1 views
- Can one model use all four RTX 5090s? 3 replies · 1 views
- Can I install whatever CUDA version I want on the rented machine? 3 replies · 1 views