At 4am Beijing time on March 19th, the NVIDIA GTC 2024 Developer Conference was held, and NVIDIA founder and CEO Huang Renxun announced the new generation AI graphics processor architecture Blackwell. The Blackwell architecture based GPU has 208 billion transistors, while the previous generation H100 GPU had 80 billion transistors.
It is reported that the Blackwell architecture adopts six revolutionary technologies, including powerful chips, second-generation Transformer engine, and fifth generation NVLink, to support AI large model training and inference with up to 10 trillion parameters.
Nvidia currently upgrades its GPU architecture every two years, significantly improving its performance. The H100 GPU based on Hopper architecture was released in 2022.