Can a GB10 run a 70B model?
Can a GB10 run a 70B model?
Rentable machine
dgx-spark
Can a GB10 run a 70B model?
Potentially, yes, if the model is quantized enough to fit together with cache and the rest of the system.
The GB10's 128 GB unified pool is the reason this can work without splitting the model across several GPUs.
I would still check the exact model and quantization before booking. '70B' alone is not enough to know the real memory footprint or speed.
Sign in to reply.
Posting guidelines
Accounts that break these can lose forum access — paid plans included. Read the full guidelines →
Related topics