[MONIT-2774] Update Apache Spark to version 3.4

This merge request updates the Apache Spark version to 3.4.0, for this:

• States that the value of kafka idempotence to be false. As of kafka-clients version 3.2.0 this flag takes the value true, while in our brokers (version 2.8) this flag is set to false. In order to be able to write to the cluster, it is therefore necessary to explicitly indicate that it takes the value false.
• Modifies the GitLab continuous integration configuration file to find the artifact in the path that is generated with the new version.
• Modifies the Apache Spark version value to 3.4.0.
• Updates the versions of the various dependencies to be compatible with Apache Spark 3.4.0.

Related JIRA Ticket: https://its.cern.ch/jira/browse/MONIT-2774

project/assembly.sbt

-addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.2")
-
-resolvers += Resolver.url("artifactory", url("http://scalasbt.artifactoryonline.com/scalasbt/sbt-plugin-releases"))(Resolver.ivyStylePatterns)
+addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.15.0")
\ No newline at end of file