Skip to content

Added option to run local spark for quick tests, and customizable baseDir when...

Andre Frankenthal requested to merge asterenb/spark_tnp:new_converter_features into master

Added option to run local spark for quick tests, and customizable baseDir when converting root to parquet

Also made it possible to run converter in both lxplus and edge nodes. Globbing the files now uses subprocess so as not to depend on the presence of an hdfs fuse mount point.

Edited by Andre Frankenthal

Merge request reports