Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%
Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%

AMD Instinct MI300X 192GB

AMD Data Center192GB HBM3 • 5.3 TB/s • 81.7 TFLOPS FP16
$18,000 - $25,0005.23%In Stock
TDP
750W
VRAM
192GB HBM3
Bandwidth
5.3 TB/s
Compute
81.7 FP16 / 1.3 PF INT8
Released
Dec 2023
Availability
In Stock

Description

The MI300X is AMD's flagship AI accelerator with 192GB HBM3 memory, designed to compete with NVIDIA H100 for large language model training and inference.

Benchmarks

LLM Inference
1.3x vs H100
HPC HPL
42.6 TFLOPS
Memory Capacity
192GB (2.4x H100)
Bandwidth
5.3 TB/s