Loading…
Glossary term
An automated series of steps that collects, cleans and prepares data.
A data pipeline is an automated chain of steps that collects data, cleans it, transforms it and delivers it where it is needed, for example into a training set or a dashboard. Running on a schedule, it keeps data fresh and consistent. Good pipelines are tested and monitored.
AI projects spend much of their effort on data, so reliable pipelines are crucial.