Loading…
Glossary term
Graphics processing unit: a chip with many parallel cores that is widely used to train and run AI models.
A graphics processing unit has thousands of small cores that do many calculations at once. That suits neural networks, whose main operation is multiplying huge matrices, so GPUs became the workhorse of AI.
Data-center GPUs add large, fast memory and high-speed links to other GPUs.
Use a GPU in PyTorch
import torch
device = "cuda" if torch.cuda.is_available() else "cpu"
model = model.to(device)
x = x.to(device)Access to GPUs largely determines who can train and serve large models, and drives a global supply race.