Performance monitoring of GPU

Here are some notes on how to monitor the utilization of GPU

The basic monitor commands

  • Monitor Memory Usage and Overall Utilization

 

Monitor Memory Usage and Overall Utilization

nvidia-smi 

Shows memory usage and utilization (https://unix.stackexchange.com/questions/38560/gpu-usage-monitoring-cuda )

watch  -d -n 0.5 nvidia-smi (-d flag can show you the change between two times)

Cutomized monitoring

nvidia-smi –format=csv –query-gpu=power.draw,utilization.gpu,fan.speed,temperature.gpu

This can be further coupled with watch to monitor real time

 

Advertisements
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s