The card has 6144 CUDA cores
Yesterday Nvidia unveiled the monstrous 188GB H100 NVL graphics accelerator for training language models, and now the company has added a card to its range that sits on the other side of the product line. The RTX 4000 Ada professional adapter is much smaller, much simpler, and clearly much cheaper, though we don’t know the price of the H100 NVL yet.
A new Nvidia 3D card with 20GB of memory and a 160-bit bus costs $1,250.
The RTX 4000 Ada, on the other hand, costs $1,250. And in terms of its parameters, this is a very unusual product. For example, it has 6144 CUDA cores (about as much is attributed to the GeForce RTX 4070 video card), 20 GB of memory, but only a 160-bit bus. At the same time, the consumption of the novelty is so small (70 W) that it does without additional power connectors!
Such a modest power consumption with good parameters is due to the GPU frequency, which reaches only 1.56 GHz. For comparison, the RTX 6000 Ada is 2.5 GHz.
The performance of the novelty (FP32) is 19.2 TFLOPS. Also noteworthy are four Mini DisplayPort connectors and a dual-slot design.
