The Nvidia A100 is the Largest GPU Ever Created
et’s start with the raw specs. The full GA100 chip has 128 SMs (streaming multiprocessor), which are the main building block of Nvidia GPUs. The previous-generation Volta GV100 for comparison maxed out at 84 SMs (with 80 enabled), so right away we’re looking at more than a 50 percent increase in potential performance, though the initial Nvidia A100 will “only” have
