Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%
Inference Volume$52.1B+5.1%
Model Rankings165updated
AI Traffic624.8K+38.2%
Global Latency11msoptimal
API Calls102.4M+12.4%
Live Agents582,391+42.1%
AI Market Cap$58.2B+5.2%
GPU Nodes6,247+10.2%

NVIDIA L40S 48GB

NVIDIA Data Center48GB GDDR6 • 864 GB/s • 90.5 TFLOPS FP32
$7,000 - $9,0008.83%In Stock
TDP
350W
VRAM
48GB GDDR6
Bandwidth
864 GB/s
Compute
90.5 FP32
Released
2023
Availability
In Stock

Description

The L40S is a powerful visual computing GPU designed for AI inference, graphics, and video workloads. Based on the Ada Lovelace architecture.

Benchmarks

Inference
1.2x vs A100
Graphics
91.6 TFLOPS
RT Core Perf
212 TRays/s
Video Encode
3x 8K60