clean up the Moore config, define Stream objects

The current Moore config file became too large to handle and maintain. This is now split into main configuration for moore/allen, report writers (creating sel/dec report banks) and stream writers (writing to file). Hlt1/hlt2/Spruce/pass configurations are made more explicit wherever needed.

A new Stream object (name, routing bit, lines, raw banks) is introduced to make stream configuration more clear. An additional Streams object holds the list of streams. This allows easy access to all lines in all streams when needed.

A new algorithm in LHCb (SimpleRawEventMover) is used to save the raw event to Event/DAQ/RawEvent when running Hlt2 by first moving the existing event to a different location, then writing the new event to default location. This is needed as online/mdf writers always write to this location so root writer can't do it without overwriting the input.

Goes with LHCb!4393 (merged) DaVinci!1009 (merged) lhcb-datapkg/PRConfig!357 (merged)

Closing #678 (closed) as a side benefit..

Hlt/Hlt2Conf/options/fest/hlt2_all_lines_with_reco_with_streams.py

@@ -18,13 +18,12 @@ Run like any other options file:
     ./Moore/run gaudirun.py hlt2_all_lines_with_reco_streams.py
 """
 from Moore import options, run_moore
+from Moore.streams import Stream, Streams
 from RecoConf.global_tools import stateProvider_with_simplified_geom
 from RecoConf.reconstruction_objects import reconstruction
 from Hlt2Conf.lines import all_lines
 import re
 
-from pprint import pprint
-
 options.evt_max = 200
 options.output_file = 'hlt2_all_lines_with_reco.{stream}.mdf'
 options.output_type = 'MDF'
@@ -51,21 +50,21 @@ def make_streams():
             spruc_lines.append(builder(persistreco=True))
         else:
             turbo_lines.append(builder())
-    linedict = dict(turbo=turbo_lines, sprucing=spruc_lines)
-    return linedict
 
+    turbo = Stream(
+        name="turbo",
+        lines=turbo_lines,
+        routing_bit=87,
+        detectors=['VP', 'UT', 'FT', 'Rich', 'Muon', 'Calo'])
+
+    sprucing = Stream(
+        name="sprucing",
+        lines=spruc_lines,
+        routing_bit=85,
+        detectors=['VP', 'UT', 'FT', 'Rich', 'Muon', 'Calo'])
 
-# Modify stream dictionaries for testing purposes
-import Moore.streams_hlt2
-DETECTOR_RAW_BANK_TYPES = ['VP', 'UT', 'FT', 'Rich', 'Calo', 'Muon']
-Moore.streams_hlt2.DETECTOR_RAW_BANK_TYPES_PER_STREAM = {
-    "sprucing": DETECTOR_RAW_BANK_TYPES,
-    "turbo": DETECTOR_RAW_BANK_TYPES,
-}
-Moore.streams_hlt2.stream_bits = dict(sprucing=85, turbo=87)
+    return Streams(streams=[turbo, sprucing])
 
-print("Moore.streams_hlt2.DETECTOR_RAW_BANK_TYPES_PER_STREAM")
-pprint(Moore.streams_hlt2.DETECTOR_RAW_BANK_TYPES_PER_STREAM)
 
 # Remove lines which contain jets
 pattern_to_remove = "(?i)(hlt2jets)"