Can one model use all four RTX 5090s?
Can one model use all four RTX 5090s?
Rentable machine
Solved NVIDIA RTX 5090
rtx-5090
- Views
- 0
- Replies
- 3
- Created
- 2026-09-05 13:30
- Last reply
- 2026-09-05 19:57
Yes, if the serving or training stack supports splitting the model across multiple GPUs.
The important part is that the four cards do not become one simple 128 GB memory pool. Your framework has to shard or parallelize the workload.
AxForge can scope the machine with you when you request 5090 capacity, but the exact setup depends on the model and runtime.
Sign in to reply.
Posting guidelines
- Be helpful and respectful
- Search before you post
- Use a clear title and tags
- Add code or a screenshot when it helps
- Keep to the topic
Accounts that break these can lose forum access — paid plans included. Read the full guidelines →
Related topics
- GPU and machine requests — ask for one we don't have yet 0 replies · 2 views
- Can I run Windows on a rented GB10? 3 replies · 1 views
- Which GPU is better for image generation? 3 replies · 1 views
- Will my normal Docker containers run on a GB10? 3 replies · 1 views
- What GPU is better for really long context? 3 replies · 1 views