airflow

obracajacy sie tekst
podwojna strzalka w dol
all articles
airflow DAG dependencies data pipelines job orchestration
The technicalities 7 min read

Passing information between DAGs in Airflow.

There are data pipelines where you must pass some values between tasks – not complete datasets, but ~ kilobytes. This can be managed even within…

check out.
airflow big data events hadoop SmartData conference
News and insights 10 min read

SmartData conference 2021

The SmartData online conference organized by the JUG.ru committee from Russia took place on Oct 11-14. It was full of interesting presentations and discussions…

check out.