Skip to content

NXCALS-4970 Restore nxcals_jars and copy hbase libs to spark-bundle jars directory

Grigorios Avgitidis requested to merge fix-NXCALS-4970-bundle-jars into develop

Manual checks that prove spark YARN successful execution on DEV environment (new bundle)

Obviously integration tests pass for this deployment...

The manual tests done on pyspark + YARN mode used also join and collect between 2 datasets:

spark_server_execution_hdfs_2021-04-29

bundle_with_join2021-04-29

spark_server_execution_hbase_2021-04-29

spark_server_app_2021-04-29

registered_apps_yarn_2021-04-29

bundle_integration_tests_yarn_2021-04-29

@acc-logging-team - please have a look for approval.

Please describe the merge request here.

Closes NXCALS-4970

Edited by Grigorios Avgitidis

Merge request reports