NVIDIA L40S - AI GPU Review & Specs

NVIDIA Ada Lovelace GPU with 48GB VRAM. New at $8,000.

48 GB
VRAM
864 GB/s
Bandwidth
58.4/100
AI Score
$8,000
Price
7.3
$ Value

Specifications

Memory Type: GDDR6

Compute Units: 18,176 (NVIDIA cores)

TDP: 350W

AI Support: Full

Performance

The NVIDIA L40S scores 58.4/100 on our AI performance index, with a value score of 7.3 (higher is better).

With 48GB of VRAM, this GPU is suitable for large language models (70B+).

Compare with Popular GPUs

vs RTX 4090vs RTX 3090vs RTX 4060 Ti 16GBvs RTX 3060 12GBvs Tesla P40vs RTX A6000

☁️ Prefer to Rent?

Not ready to buy? Rent similar GPUs by the hour:

H100 from $2.49/hr A100 from $1.09/hr RTX 4090 from $0.18/hr RTX 3090 from $0.08/hr