NVIDIA launched its GeForce RTX 40 series of graphics cards, codenamed Ada Lovelace, late last year. The GeForce RTX 4090, 4080, 4070 Ti and 4070 are already available, and the 4060 Ti is in development. The Ada Lovelace family operates TSMC's N4 (custom 5nm) node, consisting of five dies ranging from 144 mm^2 (AD107) to 608 mm^2 (AD102). The high-end AD102 GPU features 18,432 shaders across 144 SMs with 96MB of L2 cache.
I was mistaken. ????
Originally tweeted by kopite7kimi (@kopite7kimi) on May 6, 2023.
At the backend level, there are 192 ROPs, 576 TMUs and 2,304 SFUs. The AD102 chip powers the GeForce RTX 4090 with a TBP of up to 450W. The first has a peak power limit of 800W and was intended to power the RTX Titan (before it was shelved).
The upcoming RTX 50 series GPUs, codenamed Blackwell, are scheduled for release in late 2024. Like Ada, this will also be a monolithic design. According to Kopite7kimi, these GPUs will be manufactured on TSMC's 3nm (N3) node. We can expect a number of transistors in excess of a billion and densities of almost 150 billion/mm². Blackwell is expected to offer core clocks of over 3 GHz and bus widths of up to 512 bits, resulting in memory bandwidths rivaling HBM memory.