Best GPUs by Model Size

Grouped by model size based on our model recommendation pages. Use these as starting points when choosing local or cloud hardware.

1.2B

Minimum VRAM: 4 GB · Recommended VRAM: 8 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3060 12.0 GB $0.04 in_stock experimental View
Salad RTX 3070 8.0 GB $0.05 in_stock experimental View
Salad RTX 3070 Ti 8.0 GB $0.06 in_stock experimental View
Salad RTX 3080 10.0 GB $0.08 in_stock experimental View
Salad RTX 3080 Ti 12.0 GB $0.10 in_stock experimental View
RunPod RTX A2000 6.0 GB $0.12 in_stock mixed View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

8B class

Minimum VRAM: 8 GB · Recommended VRAM: 16 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3060 12.0 GB $0.04 in_stock experimental View
Salad RTX 3070 8.0 GB $0.05 in_stock experimental View
Salad RTX 3070 Ti 8.0 GB $0.06 in_stock experimental View
Salad RTX 3080 10.0 GB $0.08 in_stock experimental View
Salad RTX 3080 Ti 12.0 GB $0.10 in_stock experimental View
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

7B class

Minimum VRAM: 8 GB · Recommended VRAM: 12 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3060 12.0 GB $0.04 in_stock experimental View
Salad RTX 3070 8.0 GB $0.05 in_stock experimental View
Salad RTX 3070 Ti 8.0 GB $0.06 in_stock experimental View
Salad RTX 3080 10.0 GB $0.08 in_stock experimental View
Salad RTX 3080 Ti 12.0 GB $0.10 in_stock experimental View
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

9B

Minimum VRAM: 8 GB · Recommended VRAM: 16 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3060 12.0 GB $0.04 in_stock experimental View
Salad RTX 3070 8.0 GB $0.05 in_stock experimental View
Salad RTX 3070 Ti 8.0 GB $0.06 in_stock experimental View
Salad RTX 3080 10.0 GB $0.08 in_stock experimental View
Salad RTX 3080 Ti 12.0 GB $0.10 in_stock experimental View
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

24B

Minimum VRAM: 16 GB · Recommended VRAM: 32 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View
Salad RTX 3090 Ti 24.0 GB $0.15 in_stock experimental View
RunPod RTX A5000 24.0 GB $0.16 in_stock mixed View
RunPod RTX A4000 16.0 GB $0.17 in_stock mixed View
RunPod RTX 4000 Ada SFF 20.0 GB $0.18 in_stock mixed View
RunPod RTX A4500 20.0 GB $0.19 in_stock mixed View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

27B class

Minimum VRAM: 20 GB · Recommended VRAM: 32 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View
Salad RTX 3090 Ti 24.0 GB $0.15 in_stock experimental View
RunPod RTX A5000 24.0 GB $0.16 in_stock mixed View
RunPod RTX 4000 Ada SFF 20.0 GB $0.18 in_stock mixed View
RunPod RTX A4500 20.0 GB $0.19 in_stock mixed View
RunPod RTX 4000 Ada 20.0 GB $0.20 in_stock mixed View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

32B class

Minimum VRAM: 24 GB · Recommended VRAM: 40 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View
Salad RTX 3090 Ti 24.0 GB $0.15 in_stock experimental View
RunPod RTX A5000 24.0 GB $0.16 in_stock mixed View
TensorDock RTX 3090 24.0 GB $0.20 in_stock mixed View
RunPod RTX 3090 24.0 GB $0.22 in_stock mixed View
Salad RTX 4090 24.0 GB $0.25 in_stock experimental View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

32B

Minimum VRAM: 24 GB · Recommended VRAM: 48 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
Salad RTX 3090 24.0 GB $0.12 in_stock experimental View
Salad RTX 3090 Ti 24.0 GB $0.15 in_stock experimental View
RunPod RTX A5000 24.0 GB $0.16 in_stock mixed View
TensorDock RTX 3090 24.0 GB $0.20 in_stock mixed View
RunPod RTX 3090 24.0 GB $0.22 in_stock mixed View
Salad RTX 4090 24.0 GB $0.25 in_stock experimental View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— GeForce RTX 5090 32 GB $1,999 63.0 31.52 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay

744B total / 40B active

Minimum VRAM: 48 GB · Recommended VRAM: 80 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
RunPod RTX A6000 48.0 GB $0.33 in_stock mixed View
RunPod A40 48.0 GB $0.35 in_stock mixed View
RunPod MI300X 192.0 GB $0.50 in_stock mixed View
RunPod H200 NVL 143.0 GB $0.50 in_stock mixed View
Shadeform RTX A6000 48.0 GB $0.55 in_stock mixed View
DataCrunch RTX 8000 48.0 GB $0.59 in_stock production View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay
— NVIDIA A40 48 GB $2,500 46.5 18.6 Amazon eBay

70B class

Minimum VRAM: 48 GB · Recommended VRAM: 80 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
RunPod RTX A6000 48.0 GB $0.33 in_stock mixed View
RunPod A40 48.0 GB $0.35 in_stock mixed View
RunPod MI300X 192.0 GB $0.50 in_stock mixed View
RunPod H200 NVL 143.0 GB $0.50 in_stock mixed View
Shadeform RTX A6000 48.0 GB $0.55 in_stock mixed View
DataCrunch RTX 8000 48.0 GB $0.59 in_stock production View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay
— NVIDIA A40 48 GB $2,500 46.5 18.6 Amazon eBay

Cloud‑optimized

Minimum VRAM: 48 GB · Recommended VRAM: 80 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
RunPod RTX A6000 48.0 GB $0.33 in_stock mixed View
RunPod A40 48.0 GB $0.35 in_stock mixed View
RunPod MI300X 192.0 GB $0.50 in_stock mixed View
RunPod H200 NVL 143.0 GB $0.50 in_stock mixed View
Shadeform RTX A6000 48.0 GB $0.55 in_stock mixed View
DataCrunch RTX 8000 48.0 GB $0.59 in_stock production View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay
— NVIDIA A40 48 GB $2,500 46.5 18.6 Amazon eBay

80B

Minimum VRAM: 48 GB · Recommended VRAM: 80 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
RunPod RTX A6000 48.0 GB $0.33 in_stock mixed View
RunPod A40 48.0 GB $0.35 in_stock mixed View
RunPod MI300X 192.0 GB $0.50 in_stock mixed View
RunPod H200 NVL 143.0 GB $0.50 in_stock mixed View
Shadeform RTX A6000 48.0 GB $0.55 in_stock mixed View
DataCrunch RTX 8000 48.0 GB $0.59 in_stock production View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
— RTX 6000 Ada 48 GB $6,800 59.8 8.79 Amazon eBay
— NVIDIA L40S 48 GB $8,000 58.4 7.3 Amazon eBay
— RTX A6000 48 GB $1,150 47.5 41.3 Amazon eBay
— NVIDIA A40 48 GB $2,500 46.5 18.6 Amazon eBay

120B class

Minimum VRAM: 80 GB · Recommended VRAM: 120 GB

Best Cloud Offers

Provider GPU VRAM $/GPU‑Hr Availability Tier Link
RunPod MI300X 192.0 GB $0.50 in_stock mixed View
RunPod H200 NVL 143.0 GB $0.50 in_stock mixed View
Crusoe A100 80GB 80.0 GB $1.09 in_stock production View
RunPod A100 40GB 80.0 GB $1.19 in_stock mixed View
Shadeform A100 80GB 80.0 GB $1.19 in_stock mixed View
Lambda A100 80GB 80.0 GB $1.29 request_required production View

Best Local GPUs to Buy

RankGPUVRAMPriceAI Score$ ValueBuyCompare
— NVIDIA H100 PCIe 80 GB $30,000 100.0 3.33 Amazon eBay
VRAM Hunter · Best GPUs for AI & Machine Learning · Rent vs Buy · FAQ