Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%
Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%

NVIDIA A100 80GB PCIe

NVIDIA Data Center80GB HBM2e • 2 TB/s • 19.5 TFLOPS FP32
$10,000 - $15,0009.81%In Stock
TDP
400W
VRAM
80GB HBM2e
Bandwidth
2.0 TB/s
Compute
19.5 FP32 / 624 TF16
Released
May 2020
Availability
In Stock

Description

The A100 is NVIDIA's previous-generation data center GPU based on the Ampere architecture. Still widely used for training and inference in cloud environments.

Benchmarks

MLPerf Training
Baseline
HPC Linpack
19.5 TFLOPS
ResNet-50
10,320 img/s
BERT-Large
34.5 min