split track containers and persistency (versioning)

Introduces split-per-track-type persistency. Track, PID objects and ProtoParticles are all in split containers. Main reason to have more control over persistency.

Also fixes upstream proto/track persistency.

Tested with Hlt/Hlt2Conf/options/hlt2_2or3bodytopo_realtime.py and subsequent sprucing unpack step.

One of the things it does it cleans up and removes the use of merged containers that copy tracks/muonpid/richpid objects, but uses SharedObjectsContainer such that pointers to the individual per-track-type objects are used for merged containers.

Currently the tracks are copied to their persisted location, but this should be SharedObjectsContainers which should be persisted, this way the actual underlying object persistency is handled anonymously (needs !2281 (merged) and SharedObjectsContainers to be persisted)

It aims to fix #392 (closed). @sesen @graven @decianm

Also Ttrack reco should be cleaned up @isanders Maybe fixed in other MRs, see also #588

Also adds fixes for calohypo persistency in charged protoparticles (it started with this, this branch and got out of hand, as it needs these fixes to work).

In addition, uses work of @sbelin from Rec!3509 (closed), !2141 (closed) and DaVinci!897 (closed) (merged into the relevant branches)

Goes with LHCb!4127 (merged), Rec!3423 (merged), Alignment!394 (merged), DaVinci!926 (merged), MooreAnalysis!126 (merged), MooreOnline!268 (merged), lhcb-datapkg/PRConfig!327 (merged)

needs LHCb!4191 (merged) (cherry picked and committed to LHCb!4127 (merged))

Hlt/RecoConf/python/RecoConf/ttrack_selections_reco.py

@@ -13,8 +13,6 @@ Define the necessary reconstruction chain to go from Ttracks to particles
 """
 from RecoConf.protoparticles import make_charged_protoparticles
 from RecoConf.rich_reconstruction import make_rich_pids, default_rich_reco_options
-from RecoConf.calorimeter_reconstruction import make_calo
-from RecoConf.hlt2_global_reco import convert_tracks_to_v3_from_v1
 from RecoConf.reconstruction_objects import reconstruction
 from RecoConf.hlt2_tracking import kill_clones, make_TrackBestTrackCreator_tracks
 
@@ -23,7 +21,6 @@ from PyConf.Algorithms import (TrackListRefiner, TrackSelectionToContainer)
 from PyConf.Tools import (ParticleVertexFitter, TrackRungeKuttaExtrapolator,
                           TrackStateProvider, TrackInterpolator)
 from PyConf import configurable
-from PyConf.packing import persisted_location
 import Functors as F
 
 
@@ -96,21 +93,6 @@ def make_good_ttracks(global_reco=reconstruction,
         return fitted_filtered_tracks["Best"]
 
 
-# Calo PIDs from T tracks
-def make_ttrack_calo_pids(ttracks, pvs):
-    tracks_v3, trackrels = convert_tracks_to_v3_from_v1(
-        ttracks["v1"], track_types=["Ttrack"])
-    calo_pids = make_calo(
-        tracks_v3,
-        pvs,
-        trackrels=trackrels,
-        chargedpid_types={
-            "calo": ["Ttrack"],
-            "brem": [None]
-        })
-    return calo_pids
-
-
 # RICH PIDs from T tracks
 def make_ttrack_rich_pids(ttracks):
     return make_rich_pids(
@@ -122,7 +104,6 @@ def make_ttrack_rich_pids(ttracks):
 @configurable
 def make_ttrack_reco(global_reco, make_ttracks):
     good_ttracks = make_ttracks()
-    pvs = global_reco["PVs"]
 
     rich_pids = make_ttrack_rich_pids(good_ttracks)
     # TODO calo reco was configured wrong (to be added appropriately)