Loading…
Glossary term
NVIDIA's high-speed connection for linking GPUs together.
NVLink is NVIDIA's high-bandwidth connection between GPUs, much faster than the standard PCIe bus. It lets several GPUs share memory-like access and exchange data quickly.
Large systems connect many GPUs with NVLink switches so they behave like one big accelerator.
It speeds up the heavy communication in model-parallel training and inference.