Skip to content
Snippets Groups Projects

Saving counters result as monitoring histogram

Merged Saving counters result as monitoring histogram
dev_kholoimov_monitoring_counters_histogram into master
Merged Valerii Kholoimov requested to merge dev_kholoimov_monitoring_counters_histogram into master

Save all counter values with monitoring histograms. This will allow you to easily reach counter values in Monet.

Automatically register unsigned counters and averaging counters via the monitoring hub.

Example of counters output for MC.

image.png

For AveragingCounter saving two values in separate bins to histogram: sum of all entries and number of entries.

Some values from histogram compared to counter values from logs:

  • scifi_consolidate_seeds_matching:n_seed_tracks_sum value = 79787
  • scifi_consolidate_seeds_matching:n_seed_tracks_n_enties value = 1000
scifi_consolidate_seeds_matching INFO Number of counters : 1
| Counter | # | sum | mean/eff^* | rms/err^* | min | max |
| "n_seed_tracks" | 1000 | 79787 | 79.787 |

Values stored in float inside Allen and while passing to Gaudi to avoid integer overfilling.

To ensure accurate final value calculations when merging histograms from different machines, the average value is not stored directly for averaging counters.

In additional:

  • CaloFilterClusters moved to new monitoring system and changed to Averaging counter -> calculate average number per event, instead of global number reconstructed calo clusters per slice (general number of reconstructed calo clusters also stored in histogram).

throughput test via testbench:

master: 2025-01-16T09:49:45.012 root INFO Average total throughput: Evts/s = 75294.7

MR: 2025-01-16T09:16:10.010 root INFO Average total throughput: Evts/s = 75294.1

FYI: @adeoyang @jzhuo @dovombru @ahennequ

MONET related MR: https://gitlab.cern.ch/lhcb/Monet/-/merge_requests/108

Edited by Valerii Kholoimov

Merge request reports

Merge request pipeline #10025027 passed

Stage: check
    Stage: build
      Stage: check-warnings
        Stage: run
          Stage: test
            Stage: publish
              Stage: manual trigger
                Stage: build full
                  Stage: run full
                    Stage: test full
                      Stage: publish full
                        Stage: .post

                          Merge request pipeline passed for 18597b9a

                          Merged by Sebastien PonceSebastien Ponce 1 month ago (Jan 30, 2025 11:17am UTC)

                          Loading

                          Pipeline #10035595 passed with warnings

                          Stage: check
                            Stage: build
                              Stage: check-warnings
                                Stage: run
                                  Stage: test
                                    Stage: publish
                                      Stage: manual trigger
                                        Stage: build full
                                          Stage: run full
                                            Stage: test full
                                              Stage: publish full
                                                Stage: deploy

                                                  Pipeline passed with warnings for 72992dff on master

                                                  Activity

                                                  Filter activity
                                                  • Approvals
                                                  • Assignees & reviewers
                                                  • Comments (from bots)
                                                  • Comments (from users)
                                                  • Commits & branches
                                                  • Edits
                                                  • Labels
                                                  • Lock status
                                                  • Mentions
                                                  • Merge request status
                                                  • Tracking
                                                  Please register or sign in to reply