The fastest, most expensive graphics card, behind the global AI race

Nvidia A100 possesses impressive specifications such as 80 GB memory, 2 Tb / s bandwidth with a retail price of up to $ 30,000 and is considered the most expensive graphics card today, considered one of the essential components. of the AI ​​industry.

The fastest, most expensive graphics card, behind the global AI race Picture 1

The expensive price of Nvidia A100 is due to being manufactured on an advanced process, possessing outstanding parameters and processing power.

The Nvidia A100 is built on the advanced 7nm TSMC fabrication process, possesses 80 GB of memory, provides a maximum bandwidth of 2 Tb/s, nearly 7,000 32-bit CUDA cores, 3,500 64-bit cores, and over 400 Tensor cores. This helps give the Nvidia A100 more processing power while reducing power usage.

Nvidia A100 is considered by Tom's Hardware to be the fastest graphics card that man has ever made.

The Nvidia A100 is part of the DGX 100 system developed for data center AI. This system is packed with 8 Nvidia A100 cards that are paired together to scale to thousands of GPUs to handle any requirement.

The fastest, most expensive graphics card, behind the global AI race Picture 2

Passing through Nvidia's NVLink bridges significantly increases the bandwidth and computing power of each Nvidia A100. MIG (Multi-Instance GPU) technology allows the Nvidia A100 to be split into 7 GPU instances to run 7 different workloads at the same time.

The retail price of each Nvidia A100 is up to $ 30,000, while the DGX 100 system costs hundreds of thousands of dollars along with a service fee.

Kareem Winters

Update 27 February 2023