SignalTech/AI
Control How Your GPU Shares Work with Green Contexts
High-priority alert based on source significance and keyword relevance.
Context
What happened: NVIDIA detailed green contexts, a CUDA feature for explicitly selecting a subset of GPU execution resources and targeting work to them. Available in the Driver API since CUDA 12.4, they are accessible through the Runtime API starting with CUDA 13.1.
Key numbers: CUDA 12.4, CUDA 13.1.
Why it matters: Green contexts let applications partition SMs and provision workqueues so concurrent workloads avoid competing for the same compute units and reduce unintended serialization, offering a more explicit alternative to implicit device state and stream priority.
What changed
NVIDIA detailed green contexts, a CUDA feature for explicitly selecting a subset of GPU execution resources and targeting work to them. Available in the Driver API since CUDA 12.4, they are accessible through the Runtime API starting with CUDA 13.1.
Why it matters
Green contexts let applications partition SMs and provision workqueues so concurrent workloads avoid competing for the same compute units and reduce unintended serialization, offering a more explicit alternative to implicit device state and stream priority.