Consumercarts

Consumercarts is reader-supported. Learn more

AMD Instinct MI100 vs NVIDIA L40S: Comparison

AMD Instinct MI100 and NVIDIA L40S separate most on memory bandwidth: AMD Instinct MI100 at 1200 GB/s, NVIDIA L40S at 864 GB/s, 28% in favour of AMD Instinct MI100.

AMD Instinct MI100
AMDAMD Instinct MI100
NVIDIA L40S
NVIDIANVIDIA L40S

Specs

Specification
AMD Instinct MI100
AMD Instinct MI100
NVIDIA L40S
NVIDIA L40S
GPU BrandAMDNVIDIA
SeriesInstinct MI100 SeriesRTX Ada Generation
Board PartnerAMD (Reference)NVIDIA Reference (data center/OEM only, passive cooling)
Memory TypeHBM2GDDR6
TDP300W Peak350 W
ArchitectureCDNAAda Lovelace
Memory Bandwidth1200 GB/s864 GB/s-28%
Launch Date11/16/20202023-08
PCIe InterfacePCIe 4.0 x16 , PCIe 3.0 x16PCIe 4.0 x16

Verdict

NVIDIA L40S

8.9 / 10 Expert Rating

One of the most widely deployed data center GPUs of its generation - a genuinely strong middle ground between pure graphics cards and dedicated AI accelerators.

More comparisons in Graphics Cards