Commit 3e24efc3 authored by Domenico Giordano's avatar Domenico Giordano
Browse files

use the spark context already existing if available

parent 203bc645
......@@ -122,7 +122,7 @@ def set_spark(spark_conf=None, view_ui=False):
spark_conf.getAll(),
"Configuration data:"))
sc = SparkContext(conf=spark_conf)
sc = SparkContext.getOrCreate(spark_conf)
spark = SparkSession(sc)
print(functools.reduce(lambda x, y:
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment