Nvidia Is Developing a Line of AI GPUs with 144GB HBM3E Memory: What You Need to Know

Nvidia Is Developing a Line of AI GPUs with 144GB HBM3E Memory is easier to understand when the main concepts, benefits, limitations, and real-world uses are considered together.

This guide organizes the essential information into clear sections and adds practical context so you can make a more informed decision.

The new GPUs are expected to hit the market in the second half of this year, and will be targeted at the CSP cloud customer segment, or in other words, organizations and businesses using Cloud Service Providers ( CSP) for their cloud computing needs. Nvidia will also add a streamlined version of the B200A for enterprise OEM customers with AI needs.

It is reported that TSMC's CoWoS-L packaging capabilities (used on the B200 series) are still limited. Therefore, it is likely that the B200A series will switch to the relatively simple CoWoS-S packaging technology. This is reasonable because Nvidia is planning to focus on the B200A series to meet the requirements of Cloud Service Providers.

B200A Technical Specifications

Because it is still in the internal development stage, the technical specifications of the B200A have not yet been fully clarified. Currently, it can only be confirmed that HBM3E memory capacity will be reduced from 192GB to 144GB. There is also information that the number of memory chip layers is halved from 8 to 4. However, the capacity of a single chip increases from 24GB to 36GB.

B200A Technical Specifications illustration

Notably, the power consumption of the B200A GPU is said to be lower than the B200 and does not require liquid cooling. The new GPU's air cooling system will also make them easier to set up. The B200A is expected to be available to OEMs around the second quarter of next year.

Supply chain survey shows that NVIDIA's main high-end GPU shipments in 2024 will be based on the Hopper platform, with the H100 and H200 for the North American market and the H20 for the Chinese market. Since the B200A will hit shelves around Q2 2025, it is not expected to impact the H200 (which will launch in or after Q3).

FAQ

What should beginners know about Nvidia Is Developing a Line of AI GPUs with 144GB HBM3E Memory?

Start with the basic requirements, learn the most common terms, and test changes gradually before using advanced features.

How can I get better results with Nvidia Is Developing a Line of AI GPUs with 144GB HBM3E Memory?

Use trusted tools, follow current instructions, compare results, and review settings or limitations that may affect performance.

What mistakes should I avoid with Nvidia Is Developing a Line of AI GPUs with 144GB HBM3E Memory?

Avoid skipping requirements, relying on outdated instructions, changing multiple settings at once, or using untrusted downloads and unsupported tools.