gpu

Classes:

Gpu	GPU details for a target.
GpuInfo

class Gpu

GPU details for a target.

Attributes:

id	Index of GPU.
mem	Amount of memory available on this GPU, in bytes.
name	Identifiable model name for this GPU, e.g.,"GeForce RTX 3090".

id: int

Index of GPU. Generally based on which PCI slot the GPU occupies.

mem: int

Amount of memory available on this GPU, in bytes.

name: str

Identifiable model name for this GPU, e.g.,”GeForce RTX 3090”.

class GpuInfo

Attributes:

bus_id	PCI-Express bus address at which GPU is mounted
compute_mode	Compute mode set for this GPU.
current_pcie_link_gen	Current PCI-Express link generation for this GPU.
driver_version	Version of the GPU driver installed on the target system.
gpu_utilization	Current GPU utilization, in percent.
hw_power_limit	Whether hardware power limit is currently active.
id	Index of GPU.
max_pcie_link_gen	Maximum PCI-Express link generation supported by this GPU.
mem	Amount of memory available on this GPU, in bytes.
memory_utilization	Current memory utilization, in percent.
name	Identifiable model name for this GPU, e.g.,"GeForce RTX 3090".
persistence_mode	Persistence mode state for this GPU, either Enabled or Disabled.
power_limit	Power limit for this GPU, in watts.
sw_power_limit	Whether software power limit is currently active.
temperature	Current temperature of this GPU, in degrees Celsius.

bus_id: str

PCI-Express bus address at which GPU is mounted

compute_mode: Literal['Default', 'Exclusive Thread', 'Prohibited', 'Exclusive Process']

Compute mode set for this GPU.

current_pcie_link_gen: int

Current PCI-Express link generation for this GPU.

driver_version: str

Version of the GPU driver installed on the target system.

gpu_utilization: int

Current GPU utilization, in percent.

hw_power_limit: Literal['Not Active', 'Active']

Whether hardware power limit is currently active.

id: int

Index of GPU. Generally based on which PCI slot the GPU occupies.

max_pcie_link_gen: int

Maximum PCI-Express link generation supported by this GPU.

mem: int

Amount of memory available on this GPU, in bytes.

memory_utilization: int

Current memory utilization, in percent.

name: str

Identifiable model name for this GPU, e.g.,”GeForce RTX 3090”.

persistence_mode: Literal['Disabled', 'Enabled']

Persistence mode state for this GPU, either Enabled or Disabled.

power_limit: float

Power limit for this GPU, in watts.

sw_power_limit: Literal['Not Active', 'Active']

Whether software power limit is currently active.

temperature: int

Current temperature of this GPU, in degrees Celsius.