new structure, working ETL dag
  • adopt Airflow 2.0.1
  • fully redesign DAG definition/configuration
  • centralize spark setup
  • decouple adcern from Airflow deployment
  • adopt kerberos ticket cache for eos credentials