[MONIT-2774] Update Apache Spark to version 3.4
This merge request updates the Apache Spark version to 3.4.0, for this:
- Apache Spark version value is updated from 2.3.2 to 3.4.0 in the
dev
,qa
andstable
environment definition files. - Updated the job description for the Nomad cluster as the location of the Apache Spark libraries change with the version.
Related JIRA Ticket: https://its.cern.ch/jira/browse/MONIT-2774
Edited by Guillermo Facundo Colunga