Commit ba4ba579 authored by Domenico Giordano's avatar Domenico Giordano
Browse files

fix eos path

parent dd68544d
...@@ -28,7 +28,7 @@ def ad_etl_dag(dag_id='give_me_a_name', override_params={}): ...@@ -28,7 +28,7 @@ def ad_etl_dag(dag_id='give_me_a_name', override_params={}):
'template_config_file': '/opt/airflow/dags/scripts/anomaly_detection_tasks_cfg.json', 'template_config_file': '/opt/airflow/dags/scripts/anomaly_detection_tasks_cfg.json',
'hostgroups': ['cloud_compute/level2/batch/gva_project_013'], 'hostgroups': ['cloud_compute/level2/batch/gva_project_013'],
'code_project_name': 'Airflow_{{dag.dag_id}}', 'code_project_name': 'Airflow_{{dag.dag_id}}',
'local_cache_folder': '/eos/project-i/it-cloud-data-analytics/{{dag.dag_id}}/local_cache/', 'local_cache_folder': '/eos/project-i/it-cloud-data-analytics/Airflow/{{dag.dag_id}}/local_cache/',
'hdfs_out_folder': '/project/it_cloud_data_analytics/Airflow/{{dag.dag_id}}/raw_parquet_train/', 'hdfs_out_folder': '/project/it_cloud_data_analytics/Airflow/{{dag.dag_id}}/raw_parquet_train/',
'hdfs_cache_folder': '/project/it_cloud_data_analytics/Airflow/{{dag.dag_id}}/compressed_train/', 'hdfs_cache_folder': '/project/it_cloud_data_analytics/Airflow/{{dag.dag_id}}/compressed_train/',
'normalization_out_folder': '/project/it_cloud_data_analytics/Airflow/{{dag.dag_id}}/normalization', 'normalization_out_folder': '/project/it_cloud_data_analytics/Airflow/{{dag.dag_id}}/normalization',
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment