NVIDIA GPU Boost™ is a feature available on NVIDIA® GeForce® products and NVIDIA® Tesla® products. It makes use of any power headroom to boost application performance. In the case of Tesla, the NVIDIA GPU Boost feature is customized for compute intensive workloads running on clusters. This application note is useful for anyone who wants to take advantage of the power headroom on the Tesla K40 in a server or within a workstation. Note that GPU Boost is a system setting, which means that this Pro Tip applies to any user of a CUDA-accelerated application, not just developers.
To get started, open Nvidia Control Panel, then under 3D Settings in the navigation pane select ‘Adjust image settings with preview’. In the preview pane that opens, select ‘Use the advanced. GPU Boost continuously monitors power and temperatures, helping your GPU use every bit of performance without exceeding safety or comfort limits. GPU Boost 1 and 2.0 are not software, it's an operating instruction baked in at firmware level. You can make adjustmentsa to effect the way GPU Boost 2.0 acts upon the card using MSI Afterburner or EVGA Precision by raising target temperatures and voltage headroom. GPU Boost 2.0: Temperature Based Boosting. With the Kepler family NVIDIA introduced their GPU Boost functionality. Present on the desktop GTX 660 and above, boost allows NVIDIA’s GPUs to turbo.
The Tesla K40 board targets a specific power budget (235W) when running a highly optimized compute workload, but HPC workloads vary in power consumption and profile, as the graph in Figure 1 shows. This shows that for many applications there is power headroom. NVIDIA GPU Boost for Tesla allows customers to use available power headroom to select higher graphics clocks using NVML or nvidia-smi.
In an old post, by Saad Rahim, he benchmarks two applications with varying clocks on K40: Reverse Time Migration (RTM), a depth migration algorithm used to image complex geologies; and a Finite-difference time-domain (FDTD) electromagnetic solver. Just by using GPU Boost, he was able to measure a 18.5% performance increase in RTM versus base clocks, and over 14% improvement in FDTD, as shown in Figure 2.
You may notice a slightly superlinear performance improvement in Figure 2 for the RTM TTI benchmark. This may seem surprising, but it has a simple explanation, as described by the Tesla Application Note on GPU Boost:
In the Tesla K40, the NVIDIA GPU Boost capability allows end users to specify the boost clock which is just the core clock. The memory clock remains at 3 GHz. However, selecting higher boost clocks does improve the effective memory bandwidth utilization for workloads that are sensitive to memory bandwidth. With higher boost clocks some workloads may even see improved PCIe transfer rates. Therefore, NVIDIA GPU Boost on the Tesla K40 helps workloads which are sensitive to core clocks, power headroom and also helps workloads that may be more sensitive to memory bandwidth than core clocks.
Nvidia Gpu Boost 4.0 Download
You can find more information on GPU Boost, including instructions, scenarios, and best practices in the Tesla Application Note on GPU Boost.