Local inference, bounded honestly
Memory decides what fits. Bandwidth decides how fast.
Sourced capacity, bandwidth, price and availability for every configuration below. Decode figures are ranges traceable to a named assumption, and they stop where the evidence stops.
- configurations
- 60
- families
- 41
- models
- 32
- published ranges
- 560
- withheld
- 9,961
Capacity × bandwidth
The hardware map
Every point is a real SKU. Larger points sit on the price-free frontier.
Explore the dataset
All configurations
| Configuration | Introduced | Usable memory | Bandwidth | Price | Status |
|---|---|---|---|---|---|
| NVIDIA Rubin GPU 288 GB | 288 GB | 22,000 GB/s | Unknown | announced | |
| NVIDIA B300 SXM 288 GB | 288 GB | 8,000 GB/s | Unknown | available | |
| NVIDIA B200 SXM 180 GB | 180 GB | 8,000 GB/s | Unknown | available | |
| AMD Instinct MI300X 192 GB | 192 GB | 5,300 GB/s | Unknown | available | |
| NVIDIA H200 SXM 141 GB | 141 GB | 4,800 GB/s | Unknown | available | |
| NVIDIA H100 SXM 80 GB | 80 GB | 3,350 GB/s | Unknown | available | |
| NVIDIA A100 SXM 80 GB | 80 GB | 2,000 GB/s | Unknown | available | |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96 GB | 96 GB | 1,792 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 5090 32 GB | 32 GB | 1,792 GB/s | Unknown | available | |
| Apple M5 Ultra 512 GB | 409.6 GB | 1,200 GB/s | Unknown | announced | |
| Apple M5 Ultra 256 GB | 204.8 GB | 1,200 GB/s | $9,499 | preorder | |
| Apple M5 Ultra 96 GB | 76.8 GB | 1,200 GB/s | $5,499 | preorder | |
| AMD Instinct MI50 32 GB | 32 GB | 1,024 GB/s | Unknown | used-only | |
| NVIDIA GeForce RTX 4090 24 GB | 24 GB | 1,008 GB/s | Unknown | available | |
| NVIDIA RTX 6000 Ada Generation 48 GB | 48 GB | 960 GB/s | Unknown | available | |
| AMD Radeon RX 7900 XTX 24 GB | 24 GB | 960 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 3090 24 GB | 24 GB | 936.2 GB/s | Unknown | used-only | |
| NVIDIA L40S 48 GB | 48 GB | 864 GB/s | Unknown | available | |
| Apple M3 Ultra 512 GB | 409.6 GB | 819 GB/s | $14,869 | available | |
| Apple M3 Ultra 96 GB | 76.8 GB | 819 GB/s | Unknown | available | |
| Apple M2 Ultra 192 GB | 153.6 GB | 800 GB/s | Unknown | used-only | |
| Apple M1 Ultra 128 GB | 102.4 GB | 800 GB/s | Unknown | used-only | |
| Apple M1 Ultra 64 GB | 51.2 GB | 800 GB/s | Unknown | used-only | |
| NVIDIA GeForce RTX 4080 SUPER 16 GB | 16 GB | 736 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 4080 16 GB | 16 GB | 716.8 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 4070 Ti SUPER 16 GB | 16 GB | 672 GB/s | Unknown | available | |
| Apple M5 Max 128 GB / 614 GB/s | 102.4 GB | 614 GB/s | $5,399 | available | |
| Apple M5 Max 64 GB / 614 GB/s | 51.2 GB | 614 GB/s | $3,799 | available | |
| Apple M5 Max 48 GB / 614 GB/s | 38.4 GB | 614 GB/s | $3,399 | available | |
| Apple M4 Max 128 GB / 546 GB/s | 102.4 GB | 546 GB/s | Unknown | available | |
| Apple M4 Max 64 GB / 546 GB/s | 51.2 GB | 546 GB/s | Unknown | available | |
| Apple M4 Max 48 GB / 546 GB/s | 38.4 GB | 546 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 4070 12 GB | 12 GB | 504 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 4070 SUPER 12 GB | 12 GB | 504 GB/s | Unknown | available | |
| NVIDIA GeForce RTX 4070 Ti 12 GB | 12 GB | 504 GB/s | Unknown | available | |
| Apple M5 Max 36 GB / 460 GB/s | 28.8 GB | 460 GB/s | $2,499 | available | |
| Intel Arc Pro B60 24 GB | 24 GB | 456 GB/s | Unknown | available | |
| Intel Arc B580 12 GB | 12 GB | 456 GB/s | $249 | available | |
| Apple M4 Max 36 GB / 410 GB/s | 28.8 GB | 410 GB/s | Unknown | available | |
| NVIDIA Tesla P40 24 GB | 24 GB | 346 GB/s | Unknown | used-only | |
| AMD Ryzen Threadripper PRO 7995WX Platform 512 GB | 460.8 GB | 332.8 GB/s | Unknown | available | |
| Apple M5 Pro 64 GB | 51.2 GB | 307 GB/s | $3,199 | available | |
| Apple M5 Pro 48 GB | 38.4 GB | 307 GB/s | $2,799 | available | |
| Apple M5 Pro 24 GB | 19.2 GB | 307 GB/s | $1,699 | available | |
| NVIDIA RTX PRO 2000 Blackwell 16 GB | 16 GB | 288 GB/s | Unknown | available | |
| NVIDIA DGX Spark 128 GB | 115.2 GB | 273 GB/s | Unknown | available | |
| Apple M4 Pro 48 GB | 38.4 GB | 273 GB/s | Unknown | available | |
| Apple M4 Pro 24 GB | 19.2 GB | 273 GB/s | Unknown | available | |
| AMD Ryzen AI Max+ 395 Developer Platform 128 GB | 96 GB | 256 GB/s | Unknown | available | |
| NVIDIA Jetson AGX Orin 64 GB | 54.4 GB | 204.8 GB/s | Unknown | available | |
| Apple M6 32 GB | 25.6 GB | 170 GB/s | $1,799 | preorder | |
| Apple M6 24 GB | 19.2 GB | 170 GB/s | $1,299 | preorder | |
| Apple M5 32 GB | 25.6 GB | 153 GB/s | $2,399 | available | |
| Apple M5 24 GB | 19.2 GB | 153 GB/s | $1,499 | available | |
| Apple M5 16 GB | 12.8 GB | 153 GB/s | $1,299 | available | |
| Apple M6 16 GB | 12.8 GB | 153 GB/s | $899 | preorder | |
| Apple M4 32 GB | 25.6 GB | 120 GB/s | Unknown | available | |
| Apple M4 24 GB | 19.2 GB | 120 GB/s | $2,099 | available | |
| Apple M4 16 GB | 12.8 GB | 120 GB/s | $1,499 | available | |
| Raspberry Pi 5 8 GB | 6.4 GB | 17 GB/s | Unknown | available |
No configurations match that search.
Prefer a narrower view? Browse rankings by hardware category. Starting from a model instead? See what runs each model.