Consumercarts is reader-supported. Learn more
AMD Instinct MI100 vs NVIDIA L40: Comparison
AMD Instinct MI100 and NVIDIA L40 separate most on memory bandwidth: AMD Instinct MI100 at 1200 GB/s, NVIDIA L40 at 864 GB/s, 28% in favour of AMD Instinct MI100.
Specs
| Specification | ![]() | ![]() |
|---|---|---|
| GPU Brand | AMD | NVIDIA |
| Series | Instinct MI100 Series | RTX Ada Generation |
| Board Partner | AMD (Reference) | NVIDIA Reference (data center/OEM only, passive cooling) |
| Memory Type | HBM2 | GDDR6 |
| TDP | 300W Peak | 300 W |
| Architecture | CDNA | Ada Lovelace |
| Memory Bandwidth | 1200 GB/s | 864 GB/s-28% |
| Launch Date | 11/16/2020 | 2022-10 |
| PCIe Interface | PCIe 4.0 x16 , PCIe 3.0 x16 | PCIe 4.0 x16 |
Verdict
NVIDIA L40
8.6 / 10 Expert Rating
A versatile data center GPU that genuinely splits the difference between graphics and AI workloads - since replaced by the L40S for AI-heavy deployments but still a strong all-rounder.




