BookkeepingWatchAgent fails to add files to transformation if something goes wrong
Sometimes the BookkeepingWatchAgent fails to call TransformationClient.addFilesToTransformation
:
2023-09-14 01:31:12 UTC Transformation/BookkeepingWatchAgent/[198472] .execute INFO: Processing transformation 198472.
2023-09-14 01:31:12 UTC Transformation/BookkeepingWatchAgent/[198472] .execute INFO: Using BK query for transformation: {'ConfigName': 'LHCb', 'ConfigVersion': 'Commissioning23', 'DataQualityFlag': ['UNCHECKED', 'OK'], 'DataTakingConditions': 'Beam6800GeV-VeloClosed-MagDown-Excl-UT', 'EventType': 94000000, 'FileType': 'CHARM.DST', 'ProcessingPass': 'Real Data/SprucingPass23', 'Visible': 'Yes'}
2023-09-14 01:31:12 UTC Transformation/BookkeepingWatchAgent/[198473] .execute INFO: Using BK query for transformation: {'DataQualityFlag': ['UNCHECKED', 'OK'], 'EventType': 94000000, 'FileType': 'D02KSKSLL_COMMISSIONING2023.ROOT', 'ProductionID': 198472}
2023-09-14 01:31:13 UTC Transformation/BookkeepingWatchAgent/[198472] .execute INFO: Obtained 828 files from BK
2023-09-14 01:31:15 UTC Transformation/BookkeepingWatchAgent/[198472] .execute ERROR: Failed to add 828 lfns to transformation MySQL Error ( 1131 : Execution failed.: ( 2003: Can't connect to MySQL server on 'dbod-lbtrans.cern.ch:5518' (111) ))
2023-09-14 01:31:15 UTC Transformation/BookkeepingWatchAgent/[198472] .execute (2.3 seconds) INFO: Processed transformation
This would be okay, except on the next agent cycle the StartDate
is changed:
2023-09-14 01:55:53 UTC Transformation/BookkeepingWatchAgent/[198472] .execute INFO: Processing transformation 198472.
2023-09-14 01:55:54 UTC Transformation/BookkeepingWatchAgent/[198472] .execute INFO: Using BK query for transformation: {'ConfigName': 'LHCb', 'ConfigVersion': 'Commissioning23', 'DataQualityFlag': ['UNCHECKED', 'OK'], 'DataTakingConditions': 'Beam6800GeV-VeloClosed-MagDown-Excl-UT', 'EventType': 94000000, 'FileType': 'CHARM.DST', 'ProcessingPass': 'Real Data/SprucingPass23', 'Visible': 'Yes', 'StartDate': '2023-09-13 20:31:12'}
This results in the files never being added to the transformation and effectively being lost.