WritingBasetenBasetenpublished Oct 22, 2026seen 2d

Gpu Temperature And Utilization Metrics

Open original ↗

Captured source

source ↗
published Oct 22, 2026seen 2dcaptured 2dhttp 200method plain

GPU temperature and utilization metrics Live webinar Oct 28: How to evaluate open models for your coding agents . Save your spot

changelog / post

GPU temperature and utilization metrics

Oct 22, 2026 Go back

You can now track three additional GPU metrics in the Metrics tab for your Dedicated Inference deployments: GPU temperature : Temperature in degrees Celsius.

GPU tensor core utilization : Tensor core activity as a percentage, on GPUs with profiling support.

GPU memory bandwidth utilization : Memory read and write activity as a percentage.

Compare these graphs with request load and latency to investigate performance bottlenecks. Use Customize view in the Metrics tab to show the graphs you need. For more information, see our docs .

Explore Baseten today Start deploying Talk to an engineer

Popular models mammoth-1

elephant-1

Muse Spark Open

DeepSeek V4.1 Flash 1017

GLM-5.3 Fast

GLM-5.3-Flash

Explore all

Popular models mammoth-1

elephant-1

Muse Spark Open

DeepSeek V4.1 Flash 1017

GLM-5.3 Fast

GLM-5.3-Flash

Explore all

Notability

notability 5.0/10

Technical blog on GPU monitoring metrics.