Configuring Lineage#

Since Cosmos 1.1, it uses internally the openlineage-integration-common to parse artifacts generated with dbt commands and create lineage events. This feature is only available for the local and virtualenv execution methods (read execution modes for more information).

To emit lineage events, Cosmos can use one of the following:

  1. Airflow official OpenLineage provider, or

  2. Additional libraries.

No change to the user DAG files is required to use OpenLineage.

Installation#

If using Airflow 2.7 or higher, install apache-airflow-providers-openlineage.

Otherwise, install Cosmos using astronomer-cosmos[openlineage].

Configuration#

If using Airflow 2.7, follow the instructions on how to configure OpenLineage.

Otherwise, follow these instructions.

Namespace#

Cosmos will use the Airflow [openlineage] namespace property as a namespace, if available.

Otherwise, it attempts to use the environment variable OPENLINEAGE_NAMESPACE as the namespace.

Finally, if neither are defined, it uses "cosmos" as the namespace.