OpenLineage is an open standard and specification for collecting data-lineage metadata from data pipelines as they run. It defines a common event model describing jobs, runs, datasets, and their input/output relationships, emitted by instrumented orchestration and processing tools. This enables consistent tracking of how data is produced and transformed across heterogeneous platforms for governance, debugging, and impact analysis.
Content
- Its event model describes jobs, runs, and datasets with their input/output edges, emitted by instrumented orchestrators and engines. By unifying lineage collection across diverse platforms, OpenLineage supports governance, root-cause analysis, and impact assessment over complex data ecosystems.