Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%
Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%

Intel Gaudi3

Intel128GB HBM2e • 3.7 TB/s • 183 TFLOPS BF16
$15,000 - $20,000-2.60%Pre-order
TDP
900W
VRAM
128GB HBM2e
Bandwidth
3.7 TB/s
Compute
183 BF16
Released
2024
Availability
Pre-order

Description

Intel Gaudi3 is designed specifically for AI training and inference, offering competitive performance-per-dollar compared to NVIDIA alternatives.

Benchmarks

Training Perf
1.5x Gaudi2
Inference Perf
2x Gaudi2
BF16 Compute
183 TFLOPS
ResNet-50
19,200 img/s