NVIDIA A100 40GB - AI GPU Review & Specs

NVIDIA Ampere GPU with 40GB VRAM. Used at $2,400.

40 GB
VRAM
2039 GB/s
Bandwidth
58.4/100
AI Score
$2,400
Price
24.33
$ Value

Specifications

Memory Type: HBM2e

Compute Units: 6,912 (NVIDIA cores)

TDP: 400W

AI Support: Full

Performance

The NVIDIA A100 40GB scores 58.4/100 on our AI performance index, with a value score of 24.33 (higher is better).

With 40GB of VRAM, this GPU is suitable for large language models (70B+).

Similar GPUs

RankGPUVRAMPriceAI Score$ ValueBuyCompare
NVIDIA A40 48 GB $2,500 46.5 18.6 Amazon eBay

Compare with Popular GPUs

vs RTX 4090vs RTX 3090vs RTX 4060 Ti 16GBvs RTX 3060 12GBvs Tesla P40vs RTX A6000

☁️ Prefer to Rent?

Not ready to buy? Rent similar GPUs by the hour:

H100 from $2.49/hr A100 from $1.09/hr RTX 4090 from $0.18/hr RTX 3090 from $0.08/hr