Commit 47ece69a authored by Domenico Giordano's avatar Domenico Giordano
Browse files

support yaml

parent 687bdaa0
......@@ -50,7 +50,7 @@ def ad_etl_dag(dag_id='give_me_a_name', override_params={}):
'end_date': datetime(2021, 4, 1),
'ad_config' : {
'running_image': 'gitlab-registry.cern.ch/cloud-infrastructure/data-analytics/sparknotebook:qa-v0.4',
'template_config_file': '/opt/airflow/dags/scripts/anomaly_detection_tasks_cfg.json',
'template_config_file': '/opt/airflow/dags/scripts/anomaly_detection_tasks_cfg.yml',
'hostgroups': ['cloud_compute/level2/batch/gva_project_013'],
'code_project_name': 'Airflow_{{dag.dag_id}}_{{ds}}',
'local_cache_folder': '/eos/project-i/it-cloud-data-analytics/Airflow/v0.4/{{dag.dag_id}}/local_cache/',
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment