Data Pipelines with Apache Airflow

GitHub:
https://github.com/BasPH/data-pipelines-with-apache-airflow

Data:

$ curl -L "https://ll.thespacedevs.com/2.0.0/launch/upcoming" | jq

$ cd ~/tmp
$ git clone https://github.com/BasPH/data-pipelines-with-apache-airflow.git

$ cd chapter02/
$ cd scripts/

// В скрипте добавить  \ после --name airflow
$ ./listing_2_10.sh

// admin / admin http://localhost:8080

Запускаем DAG

$ docker exec -it airflow /bin/bash

$ ls /tmp/images/
ariane_5_eca25_image_20200220090552.jpeg
atlas2520v2520531_image_20190222030726.jpeg
falcon2520925_image_20220722061450.png
falcon2520925_image_20220722151528.png
falcon2520925_image_20220803024417.png
long2520march252011_image_20190222031217.jpeg
long2520march25202d_image_20190222031211.jpeg
rs1_image_20211102160004.jpg
space_launch_sy_image_20220331082429.jpeg
zhuque-2_image_20200905210848.jpg