Table of contents

• What is Airflow?
• What's the point of Airflow?
• What can and can't it do?
• The Dag
• The Operators
• Trigger Rules

Requirements

• To have docker and docker-compose installed.
• Install docker and docker-compose exactly as it is described in the website.
• do not do do apt install docker or docker-compose

How to spin the webserver up

Prepping

First, get your id:

id -u

Now edit the .env file and swap out 501 for your own.

Run the following command to creat the volumes needed in order to send data to airflow:

mkdir -p ./dags ./logs ./plugins

And this once:

docker-compose up airflow-init

If the exit code is 0 then it's all good.

Running

docker-compose up

After it is up, add a new connection:

• Name - postgres_default
• Conn type - postgres
• Host - localhost
• Port - 5432
• Database - airflow
• Username - airflow
• Password - airflow