StoreGateSvc add option to dump the Arena stats (!62764) · Merge requests · atlas / athena

Christos Anastopoulos requested to merge ATLAS-EGamma/athena:SGImplSvc_arena_stats into 23.0 Apr 28, 2023

StoreGateSvc add option to dump the Arena stats

Adding something like this in postExecx

cfg.getService("StoreGateSvc").DumpArena = True

In a test (Overlay) I see

TRT_OverlayDigitizat...TRT_OverlayDigitizationTool     7     6    INFO Gas Property:             UseGasMix is  'UseGasMix':0
0_StoreGateSvc_Impl                                    1     0    INFO Report for Arena: 0_StoreGateSvc_Impl
Elts InUse/Free/Total   Bytes InUse/Free/Total  Blocks InUse/Free/Total             
       5/     14/     19    1072/   2912/   3984       1/      0/      1  SG::ArenaCachingHandle<HepMC3::GenEvent,SG::ArenaPoolAllocator>
    1830/     80/   1910  219664/   9600/ 229264       2/      0/      2  SG::ArenaCachingHandle<HepMC3::GenVertex,SG::ArenaPoolAllocator>
    2919/    151/   3070  350344/  18120/ 368464       2/      0/      2  SG::ArenaCachingHandle<HepMC3::GenParticle,SG::ArenaPoolAllocator>
   14208/    553/  14761 1364064/  53088/1417152       3/      0/      3  SG::ArenaCachingHandle<TileRawChannel,SG::ArenaPoolAllocator>
   83087/    770/  83857 1996232/  18480/2014712      67/      0/     67  SG::ArenaCachingHandle<LArHit,SG::ArenaPoolAllocator>
  650617/    761/ 651378 15632280/  18264/15650544     546/      0/    546  SG::ArenaCachingHandle<TRT_LoLumRawData,SG::ArenaPoolAllocator>
  895437/    935/ 896372 43006864/  44880/43051744     809/      0/    809  SG::ArenaCachingHandle<SCT3_RawData,SG::ArenaPoolAllocator>
  203356/    443/ 203799 4883392/  10632/4894024      89/      0/     89  SG::ArenaCachingHandle<Pixel1RawData,SG::ArenaPoolAllocator>
                                                                                    
AthenaHiveEventLoopMgr                                 1     0    INFO   ===>>>  done processing event #225293015, run #310000 on slot 0,  3 events processed so far  <<<===
AthenaHiveEventLoopMgr                                10     0    INFO   ===>>>  using secondary event #225293090 instead of #26304151  <<<===
AthenaHiveEventLoopMgr                                10     0    INFO   ===>>>  start processing event #225293090, run #310000 on slot 0,  3 events processed so far  <<<===
5_StoreGateSvc_Impl                                    6     5    INFO Report for Arena: 5_StoreGateSvc_Impl
Elts InUse/Free/Total   Bytes InUse/Free/Total  Blocks InUse/Free/Total             
       5/     14/     19    1072/   2912/   3984       1/      0/      1  SG::ArenaCachingHandle<HepMC3::GenEvent,SG::ArenaPoolAllocator>
    1684/     21/   1705  202144/   2520/ 204664       2/      0/      2  SG::ArenaCachingHandle<HepMC3::GenVertex,SG::ArenaPoolAllocator>
    2761/      2/   2763  331384/    240/ 331624       2/      0/      2  SG::ArenaCachingHandle<HepMC3::GenParticle,SG::ArenaPoolAllocator>
   14209/    552/  14761 1364160/  52992/1417152       3/      0/      3  SG::ArenaCachingHandle<TileRawChannel,SG::ArenaPoolAllocator>
   88895/    808/  89703 2134792/  19392/2154184      41/      0/     41  SG::ArenaCachingHandle<LArHit,SG::ArenaPoolAllocator>
  531230/    242/ 531472 12755792/   5808/12761600     196/      0/    196  SG::ArenaCachingHandle<TRT_LoLumRawData,SG::ArenaPoolAllocator>
  508190/   1107/ 509297 24400672/  53136/24453808     236/      0/    236  SG::ArenaCachingHandle<SCT3_RawData,SG::ArenaPoolAllocator>
  101020/    181/ 101201 2424576/   4344/2428920       3/      0/      3  SG::ArenaCachingHandle<Pixel1RawData,SG::ArenaPoolAllocator>
                                                                                    
AthenaHiveEventLoopMgr                                 6     5    INFO   ===>>>  done processing event #225293058, run #310000 on slot 5,  4 events processed so far  <<<===
AthenaHiveEventLoopMgr                                11     5    INFO   ===>>>  using secondary event #225293095 instead of #26304167  <<<===
AthenaHiveEventLoopMgr                                11     5    INFO   ===>>>  start processing event #225293095, run #310000 on slot 5,  4 events processed so far  <<<===
3_StoreGateSvc_Impl                                    4     3    INFO Report for Arena: 3_StoreGateSvc_Impl
Elts InUse/Free/Total   Bytes InUse/Free/Total  Blocks InUse/Free/Total             
       5/     14/     19    1072/   2912/   3984       1/      0/      1  SG::ArenaCachingHandle<HepMC3::GenEvent,SG::ArenaPoolAllocator>
    2789/      8/   2797  334744/    960/ 335704       2/      0/      2  SG::ArenaCachingHandle<HepMC3::GenVertex,SG::ArenaPoolAllocator>
    4378/     23/   4401  525424/   2760/ 528184       2/      0/      2  SG::ArenaCachingHandle<HepMC3::GenParticle,SG::ArenaPoolAllocator>
   14208/    553/  14761 1364064/  53088/1417152       3/      0/      3  SG::ArenaCachingHandle<TileRawChannel,SG::ArenaPoolAllocator>
  130788/    866/ 131654 3140864/  20784/3161648      61/      0/     61  SG::ArenaCachingHandle<LArHit,SG::ArenaPoolAllocator>
  552692/    254/ 552946 13271456/   6096/13277552     214/      0/    214  SG::ArenaCachingHandle<TRT_LoLumRawData,SG::ArenaPoolAllocator>
  567997/     24/ 568021 27273104/   1152/27274256     289/      0/    289  SG::ArenaCachingHandle<SCT3_RawData,SG::ArenaPoolAllocator>
  104564/    216/ 104780 2509728/   5184/2514912       6/      0/      6  SG::ArenaCachingHandle<Pixel1RawData,SG::ArenaPoolAllocator>

and then at the end

Elts InUse/Free/Total   Bytes InUse/Free/Total  Blocks InUse/Free/Total         
       0/     19/     19       0/   3984/   3984       0/      1/      1  SG::ArenaCachingHandle<HepMC3::GenEvent,SG::ArenaPoolAllocator>
       0/   2319/   2319       0/ 278376/ 278376       0/      3/      3  SG::ArenaCachingHandle<HepMC3::GenVertex,SG::ArenaPoolAllocator>
       0/   3752/   3752       0/ 450336/ 450336       0/      3/      3  SG::ArenaCachingHandle<HepMC3::GenParticle,SG::ArenaPoolAllocator>
       0/  14761/  14761       0/1417152/1417152       0/      3/      3  SG::ArenaCachingHandle<TileRawChannel,SG::ArenaPoolAllocator>
       0/  86597/  86597       0/2080280/2080280       0/     61/     61  SG::ArenaCachingHandle<LArHit,SG::ArenaPoolAllocator>
       0/ 339405/ 339405       0/8153272/8153272       0/    236/    236  SG::ArenaCachingHandle<TRT_LoLumRawData,SG::ArenaPoolAllocator>
       0/ 250084/ 250084       0/12004704/12004704       0/     21/     21  SG::ArenaCachingHandle<SCT3_RawData,SG::ArenaPoolAllocator>
       0/ 100008/ 100008       0/2400256/2400256       0/      2/      2  SG::ArenaCachingHandle<Pixel1RawData,SG::ArenaPoolAllocator>
                                                                                
1_StoreGateSvc_Impl                                               INFO Report for Arena: 1_StoreGateSvc_Impl
Elts InUse/Free/Total   Bytes InUse/Free/Total  Blocks InUse/Free/Total         
       0/     19/     19       0/   3984/   3984       0/      1/      1  SG::ArenaCachingHandle<HepMC3::GenEvent,SG::ArenaPoolAllocator>
       0/   1773/   1773       0/ 212824/ 212824       0/      2/      2  SG::ArenaCachingHandle<HepMC3::GenVertex,SG::ArenaPoolAllocator>
       0/   2865/   2865       0/ 343864/ 343864       0/      2/      2  SG::ArenaCachingHandle<HepMC3::GenParticle,SG::ArenaPoolAllocator>
       0/  14761/  14761       0/1417152/1417152       0/      3/      3  SG::ArenaCachingHandle<TileRawChannel,SG::ArenaPoolAllocator>
       0/  39369/  39369       0/ 945912/ 945912       0/     33/     33  SG::ArenaCachingHandle<LArHit,SG::ArenaPoolAllocator>
       0/ 397874/ 397874       0/9557872/9557872       0/    278/    278  SG::ArenaCachingHandle<TRT_LoLumRawData,SG::ArenaPoolAllocator>
       0/ 264420/ 264420       0/12692864/12692864       0/     22/     22  SG::ArenaCachingHandle<SCT3_RawData,SG::ArenaPoolAllocator>
       0/ 100166/ 100166       0/2404304/2404304       0/     10/     10  SG::ArenaCachingHandle<Pixel1RawData,SG::ArenaPoolAllocator>
                                                                                
2_StoreGateSvc_Impl                                               INFO Report for Arena: 2_StoreGateSvc_Impl
Elts InUse/Free/Total   Bytes InUse/Free/Total  Blocks InUse/Free/Total         
       0/     19/     19       0/   3984/   3984       0/      1/      1  SG::ArenaCachingHandle<HepMC3::GenEvent,SG::ArenaPoolAllocator>
       0/   2316/   2316       0/ 278112/ 278112       0/      6/      6  SG::ArenaCachingHandle<HepMC3::GenVertex,SG::ArenaPoolAllocator>
       0/   3649/   3649       0/ 438040/ 438040       0/      5/      5  SG::ArenaCachingHandle<HepMC3::GenParticle,SG::ArenaPoolAllocator>
       0/  14761/  14761       0/1417152/1417152       0/      3/      3  SG::ArenaCachingHandle<TileRawChannel,SG::ArenaPoolAllocator>
       0/  39373/  39373       0/ 945944/ 945944       0/     31/     31  SG::ArenaCachingHandle<LArHit,SG::ArenaPoolAllocator>
       0/ 397856/ 397856       0/9557760/9557760       0/    288/    288  SG::ArenaCachingHandle<TRT_LoLumRawData,SG::ArenaPoolAllocator>
       0/ 267739/ 267739       0/12852368/12852368       0/     28/     28  SG::ArenaCachingHandle<SCT3_RawData,SG::ArenaPoolAllocator>
       0/ 100159/ 100159       0/2404264/2404264       0/     14/     14  SG::ArenaCachingHandle<Pixel1RawData,SG::ArenaPoolAllocator>

@ssnyder can you take a look at this? Not 100% if all the placements make sense. The clearStore I picked as is where we call reset . then due to locks wanted to have it somehow separate .

@jchapman I think now some of the things we see make a bit more sense ...

Edited Apr 29, 2023 by Christos Anastopoulos

StoreGateSvc add option to dump the Arena stats

Merge request reports