Consumercarts

Consumercarts is reader-supported. Learn more

AMD Instinct MI100 vs NVIDIA L40: Comparison

AMD Instinct MI100 and NVIDIA L40 separate most on memory bandwidth: AMD Instinct MI100 at 1200 GB/s, NVIDIA L40 at 864 GB/s, 28% in favour of AMD Instinct MI100.

Specs

Specification
AMD Instinct MI100
AMD Instinct MI100
NVIDIA L40
NVIDIA L40
GPU BrandAMDNVIDIA
SeriesInstinct MI100 SeriesRTX Ada Generation
Board PartnerAMD (Reference)NVIDIA Reference (data center/OEM only, passive cooling)
Memory TypeHBM2GDDR6
TDP300W Peak300 W
ArchitectureCDNAAda Lovelace
Memory Bandwidth1200 GB/s864 GB/s-28%
Launch Date11/16/20202022-10
PCIe InterfacePCIe 4.0 x16 , PCIe 3.0 x16PCIe 4.0 x16

Verdict

NVIDIA L40

8.6 / 10 Expert Rating

A versatile data center GPU that genuinely splits the difference between graphics and AI workloads - since replaced by the L40S for AI-heavy deployments but still a strong all-rounder.

More comparisons in Graphics Cards