NVIDIA A40 PCIe vs NVIDIA RTX A4000
Graphics Processor
| GPU model | GA102 | GA104 |
|---|---|---|
| Architecture | Ampere | Ampere |
| Foundry | Samsung | Samsung |
| Manufacturing process | 8 nm | 8 nm |
| Number of transistors | 28,300 million | 17,400 million |
| Die size | 628 mm² | 392 mm² |
| GPU variant | — | GA104-875-A1 |
Graphics Card
| Release date | Oct 5th, 2020 | Apr 12th, 2021 |
|---|---|---|
| gpu.details.availability | 2021 | — |
| Generation | Tesla | Quadro |
| Production | Active | Active |
| Interface | PCIe 4.0 x16 | PCIe 4.0 x16 |
Clocks
| Base clock | 1305 MHz | 735 MHz |
|---|---|---|
| Boost clock | 1740 MHz | 1560 MHz |
| Memory clock | 1812 MHz 14.5 Gbps effective | 1750 MHz 14 Gbps effective |
Memory Configuration
| Memory size | 48 GB | 16 GB |
|---|---|---|
| Memory type | GDDR6 | GDDR6 |
| Memory bus width | 384 bit | 256 bit |
| Bandwidth | 695.8 GB/s | 448.0 GB/s |
Render Configuration
| Shading units | 10752 | 6144 |
|---|---|---|
| TMUs | 336 | 192 |
| ROPs | 112 | 96 |
| SM count | 84 | 48 |
| Tensor cores | 336 | 192 |
| RT cores | 84 | 48 |
| Cache L1 | 128 KB (per SM) | 128 KB (per SM) |
| Cache L2 | 6 MB | 4 MB |
Performance
| Pixel rate | 194.9 GPixel/s | 149.8 GPixel/s |
|---|---|---|
| Texture rate | 584.6 GTexel/s | 299.5 GTexel/s |
| FP16 (half) performance | 37.42 TFLOPS (1:1) | 19.17 TFLOPS (1:1) |
| FP32 (float) performance | 37.42 TFLOPS | 19.17 TFLOPS |
| FP64 (double) performance | 1,169 GFLOPS (1:32) | 599.0 GFLOPS (1:32) |
Dimensions & Outputs
| Slot width | Dual-slot | Single-slot |
|---|---|---|
| Length | 267 mm 10.5 inches | 241 mm 9.5 inches |
| Width | 112 mm 4.4 inches | 112 mm 4.4 inches |
| TDP | 300 W | 140 W |
| Suggested PSU | 700 W | 300 W |
| Outputs | 3x DisplayPort | 4x DisplayPort |
| Power connectors | 8-pin EPS | 1x 6-pin |
API Support & Features
| DirectX | 12 Ultimate (12_2) | 12 Ultimate (12_2) |
|---|---|---|
| OpenGL | 4.6 | 4.6 |
| OpenCL | 3.0 | 3.0 |
| Vulkan | 1.2 | 1.2 |
| CUDA | 8.6 | 8.6 |
| Shader model | 6.6 | 6.6 |
