clean up the Moore config, define Stream objects

The current Moore config file became too large to handle and maintain. This is now split into main configuration for moore/allen, report writers (creating sel/dec report banks) and stream writers (writing to file). Hlt1/hlt2/Spruce/pass configurations are made more explicit wherever needed.

A new Stream object (name, routing bit, lines, raw banks) is introduced to make stream configuration more clear. An additional Streams object holds the list of streams. This allows easy access to all lines in all streams when needed.

A new algorithm in LHCb (SimpleRawEventMover) is used to save the raw event to Event/DAQ/RawEvent when running Hlt2 by first moving the existing event to a different location, then writing the new event to default location. This is needed as online/mdf writers always write to this location so root writer can't do it without overwriting the input.

Goes with LHCb!4393 (merged) DaVinci!1009 (merged) lhcb-datapkg/PRConfig!357 (merged)

Closing #678 (closed) as a side benefit..

Hlt/Moore/python/Moore/config.py

@@ -30,7 +30,7 @@ from .streams import make_default_streams, Stream
 from .stream_writers import stream_writer
 from .reports_writers import report_writers_nodes
 
-# These are not really needed here, but most lines import them from config instead lines module
+# These are not really needed here, but most lines import them from config instead of lines module
 from .lines import HltLine, Hlt2Line, SpruceLine
 
 #: Regular expression (compiled) defining the valid selection line names
@@ -179,7 +179,7 @@ def moore_control_flow(options, streams, process, analytics=False):
 
     stream_writers = []
     for stream in streams.streams:
-        pre_algs, post_algs = stream_writer(
+        post_algs = stream_writer(
             options=options,
             stream=stream,
             process=process,
@@ -405,13 +405,12 @@ def allen_control_flow(options, write_all_input_leaves=True):
         children=algs,
         force_order=True)
 
-    writer_setup = []
     writers = [report_writers_node]
 
     if options.output_file:
         # Give stream a name: 'default'
         stream = Stream(name="default", lines=[])
-        pre_algs, post_algs = stream_writer(
+        post_algs = stream_writer(
             options=options,
             stream=stream,
             process="hlt1",
@@ -422,7 +421,7 @@ def allen_control_flow(options, write_all_input_leaves=True):
             dst_data=[],
             dec_reports=None,
             write_all_input_leaves=write_all_input_leaves)
-        writer_setup += pre_algs
+
         writers += post_algs
 
     allen_algs = [non_event_data_node, allen_cf]
@@ -441,7 +440,7 @@ def allen_control_flow(options, write_all_input_leaves=True):
     allen = CompositeNode(
         'MooreAllen',
         combine_logic=NodeLogic.LAZY_AND,
-        children=writer_setup + [allen_node, make_allen_decision()] + writers,
+        children=[allen_node, make_allen_decision()] + writers,
         force_order=True)
 
     return allen
@@ -595,3 +594,12 @@ def has_global_event_cut(node: CompositeNode) -> bool:
     return any(
         isinstance(n, Algorithm) and n.typename == "PrGECFilter"
         for n in traverse_node_and_children(node))
+
+
+def dummy_function_for_line_imports():
+
+    a_line = HltLine(name="UnusedHltLine")
+    b_line = Hlt2Line(name="UnusedHltLine")
+    c_line = SpruceLine(name="UnusedHltLine")
+
+    return (a_line, b_line, c_line)