NVIDIA H100 PCIe - AI GPU Review & Specs

NVIDIA Hopper GPU with 80GB VRAM. New at $30,000.

80 GB
VRAM
2039 GB/s
Bandwidth
100.0/100
AI Score
$30,000
Price
3.33
$ Value

Specifications

Memory Type: HBM2e

Compute Units: 14,592 (NVIDIA cores)

TDP: 350W

AI Support: Full

Performance

The NVIDIA H100 PCIe scores 100.0/100 on our AI performance index, with a value score of 3.33 (higher is better).

With 80GB of VRAM, this GPU is suitable for large language models (70B+).

Compare with Popular GPUs

vs RTX 4090vs RTX 3090vs RTX 4060 Ti 16GBvs RTX 3060 12GBvs Tesla P40vs RTX A6000

☁️ Prefer to Rent?

Not ready to buy? Rent similar GPUs by the hour:

H100 from $2.49/hr A100 from $1.09/hr RTX 4090 from $0.18/hr RTX 3090 from $0.08/hr