Datacenter Server
DGX H100
A single server holding 8 H100 GPUs wired together with NVLink, for a combined 640GB of GPU memory. This is real clustering: all 8 GPUs can address each other's memory at very high bandwidth, not just sit in the same box.
640 GB
GPU memory — how large a model (in parameters) can be loaded and run.
10,200 W
Power draw — equivalent to 8.50 average homes running around the clock.
$375,000
Price for this unit as configured.
8
GPUs in this unit.