Commit 6f2354ae authored by Domenico Giordano's avatar Domenico Giordano
Browse files

fix spark_context

parents b344ec7c 3e24efc3
......@@ -122,7 +122,7 @@ def set_spark(spark_conf=None, view_ui=False):
spark_conf.getAll(),
"Configuration data:"))
sc = SparkContext(conf=spark_conf)
sc = SparkContext.getOrCreate(spark_conf)
spark = SparkSession(sc)
print(functools.reduce(lambda x, y:
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment