Skip to content

Draft: Script for data dependencies

Carlo Varni requested to merge cvarni/athena:ScriptForDataDependencies into main

This adds a python script for parsing a reco job log file and create a graph of the data dependencies of the algorithms (.md extension).

Requirement: the reco job must be in MT mode (at least 1 thread) and the flag Scheduler.ShowDataDeps must be set on True

I found this extremely useful while debugging what was going on in our ACTS chains, especially in understanding why the scheduler was complaining about stalls or why read handles were not valid. So I guess I could simply put this in Athena so that it can be used by others as well. It creates graphs like this one: https://codimd.web.cern.ch/s/4JEJMBm1P

Example of use: python3 makeDataDependencyGraph.py --inputLog ../utils/output.multithreaded.txt --pattern '.*Acts.*' --output graph.md

/cc @adye @pagessin @tbold @bkerridg @ncalace

Edited by Carlo Varni

Merge request reports