NVIDIA A40 - AI GPU Review & Specs

NVIDIA Ampere GPU with 48GB VRAM. Used at $2,500.

48 GB
VRAM
696 GB/s
Bandwidth
46.5/100
AI Score
$2,500
Price
18.6
$ Value

Specifications

Memory Type: GDDR6

Compute Units: 10,752 (NVIDIA cores)

TDP: 300W

AI Support: Full

Performance

The NVIDIA A40 scores 46.5/100 on our AI performance index, with a value score of 18.6 (higher is better).

With 48GB of VRAM, this GPU is suitable for large language models (70B+).

Similar GPUs

RankGPUVRAMPriceAI Score$ ValueBuyCompare
NVIDIA A100 40GB 40 GB $2,400 58.4 24.33 Amazon eBay

Compare with Popular GPUs

vs RTX 4090vs RTX 3090vs RTX 4060 Ti 16GBvs RTX 3060 12GBvs Tesla P40vs RTX A6000

☁️ Prefer to Rent?

Not ready to buy? Rent similar GPUs by the hour:

H100 from $2.49/hr A100 from $1.09/hr RTX 4090 from $0.18/hr RTX 3090 from $0.08/hr