Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%
Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%

NVIDIA H100 SXM5 80GB

NVIDIA Data Center80GB HBM3 • 3.35 TB/s • 67 TFLOPS FP32
$25,000 - $40,0004.54%In Stock
TDP
700W
VRAM
80GB HBM3
Bandwidth
3.35 TB/s
Compute
67 FP32 / 3,958 FP8
Released
Sep 2022
Availability
In Stock

Description

The H100 is NVIDIA's flagship data center GPU built on the Hopper architecture. Features fourth-gen Tensor Cores with FP8 precision, Transformer Engine, and NVLink for massive GPU clusters.

Benchmarks

MLPerf Training
2.8x vs A100
HPC Linpack
51.2 TFLOPS
ResNet-50
28,848 img/s
BERT-Large
12.1 min