Desktop GPU
GeForce RTX 4090
A top-end gaming card that doubles as a cheap way to experiment with small open-source models locally. 24GB of memory is enough for models up to roughly 15-18B parameters, or for fine-tuning small models. Not enough memory for any of the frontier open models on this site.
24 GB
GPU memory — how large a model (in parameters) can be loaded and run.
450 W
Power draw — equivalent to 0.38 average homes running around the clock.
$2,500
Price for this unit as configured.
1
GPU in this unit.