- Aug 05, 2015
-
-
Graeme Stewart authored
- Allow --skipEvents to be multi-valued (needed by FTK transforms) * scripts/makeTrfJSONSignatures.py - Skip beamSpotT0_Vertex_tf.py, which is a not a PyJobTransforms transform and causes an abort when using __import__ * test/test_trfArgs.py - Do configureFromJSON test with Athena_tf.py instead of Reco_tf.py (which is in a different project, this a problem in ATN during full builds) * Tagging PyJobTransforms-02-03-60 (PyJobTransforms-02-03-60) * python/trfArgs.py - Allow --skipEvents to be multi-valued (needed by FTK transforms) * scripts/makeTrfJSONSignatures.py - Skip beamSpotT0_Vertex_tf.py, which is a not a PyJobTransforms transform and causes an abort when using __import__ * test/test_trfArgs.py - Do configureFromJSON test with Athena_tf.py instead of Reco_tf.py (which is in a different project, this a problem in ATN during full builds) * Tagging PyJobTransforms-02-03-60 2015-07-08 Lisa Errenst <lisa.errenst@cern.ch> * python/trfReports.py - add HEPSPEC to machine report. Report version 1.0.5 2015-07-03 Graeme Stewart <graeme.andrew.stewart@cern.ch> * python/transform.py - Refactor handling of end of transform to always try to kill stray children * python/trfArgClasses.py - Move _mergeArgs methog from argAthenaFile to argFile so that argNTUP has access * python/trfArgs.py ... (Long ChangeLog diff - truncated)
-
- May 17, 2015
-
-
Graeme Stewart authored
- Add new auxiliaryFile property to argFile, signaling that a file should not be validated or appear in the jobReport * python/trfExe.py - Add memMonitor property to scriptExecutor, that will try to use the external MemoryMonitor binary to memory monitor the script executor's child process - MemoryMonitor is launched immediately after the scriptExecutor's child process and the memory summary JSON file parsed afterwards and added to the executor memory report - Deprecate the perfMonFile property of athenaExecutor and stop parsing any perfmon outputs - For DBRelease files, dereference all soft links, allowing for use with the pre-release DBRelease-pcache-current.tar.gz link - Change suffix on multiple-merged outputs after AthenaMP has run to _N (as expected by PanDA) * python/trfFileUtils.py - Add inpFileInterestingKeys (not yet used) * python/trfReports.py - Update report version number to 1.0.1 - Modify top level report 'resource' entry to have entries per executor with MemoryMonitor summary information and a separate entry for the transform and its externals - Add machine report information to resource entry, with information also parsed from /proc/cpuinfo * python/trfUtils.py - Add small debug message when setting up a DBRelease from CVMFS * python/trfValidation.py - Ensure that auxilliary files are never validated * test/test_trfUtilsDBRelease.py - Add new test for DBRelease-pcache-current.tar.gz link * Tag PyJobTransforms-02-03-48 (PyJobTransforms-02-03-48) * python/trfArgClasses.py - Add new auxiliaryFile property to argFile, signaling that a file should not be validated or appear in the jobReport * python/trfExe.py - Add memMonitor property to scriptExecutor, that will try to use the external MemoryMonitor binary to memory monitor the script executor's child process - MemoryMonitor is launched immediately after the scriptExecutor's child process and the memory summary JSON file parsed afterwards and added to the executor memory report - Deprecate the perfMonFile property of athenaExecutor and stop parsing any perfmon outputs - For DBRelease files, dereference all soft links, allowing for use with the pre-release DBRelease-pcache-current.tar.gz link - Change suffix on multiple-merged outputs after AthenaMP has run to _N (as expected by PanDA) * python/trfFileUtils.py - Add inpFileInterestingKeys (not yet used) * python/trfReports.py - Update report version number to 1.0.1 - Modify top level report 'resource' entry to have entries per executor ... (Long ChangeLog diff - truncated)
-
- Jan 19, 2015
-
-
Graeme Stewart authored
New way to elevate std::bad_alloc message to "CATASTROPHE" (level = fatal + 10) Improved GetTfCommand.py Wider test coverage * Tag PyJobTransforms-02-03-37 (PyJobTransforms-02-03-37) * Tag PyJobTransforms-02-03-37 2014-12-18 Azzah Alshehri <azzah.aziz.alshehri@cern.ch> * python/trfArgClasses.py - Convert the member variable self._desc in prodsysDescription method to be a local variable. - Pass the argument groups into the json signature so that the AMI can use it to layout arguments sensibly when defining tags 2014-12-17 Graeme Stewart <graeme.andrew.stewart@cern.ch> * python/trfArgs.py - Add new argument group 'Metadata' - Add task, job, attempt arguments in metadata group - Make metadata arguments a part of standard transform arguments - Fix missing group for athenaMPMergeTargetSize * test/test_trfValidation.py - Clean up all test logfiles 2014-12-17 Graeme Stewart <graeme.andrew.stewart@cern.ch> * python/transform.py - Small change in startup message * python/trfExe.py ... (Long ChangeLog diff - truncated)
-
- Nov 05, 2014
-
-
Graeme Stewart authored
- Change default option in hybridMerge to be "slow" merging, due to persistent issues with fast merged metadata * trfReports.py - Fix bad reference to _maxMsgLen in python report generator * trfValidation.py - Add file count validation for DAOD merging transform * test_AODMerge_tf.py - Account for metadata 'compression' in metadata value test case * Tag PyJobTransforms-02-03-29 (PyJobTransforms-02-03-29) * trfExe.py - Change default option in hybridMerge to be "slow" merging, due to persistent issues with fast merged metadata * trfReports.py - Fix bad reference to _maxMsgLen in python report generator * trfValidation.py - Add file count validation for DAOD merging transform * test_AODMerge_tf.py - Account for metadata 'compression' in metadata value test case * Tag PyJobTransforms-02-03-29 2014-09-19 Graeme Stewart <graeme.andrew.stewart@cern.ch> * trfAMI.py - Introduce test for 'new transform' and make sure that command line arguments are prefixed by "--" * trfReport.py - Truncate very long error messages in exitMsg * trfArgClasses.py - Refactor EOS globbing code to improve robustness and error messages * Tag PyJobTransforms-02-03-28 ... (Long ChangeLog diff - truncated)
-
- Sep 19, 2014
-
-
Graeme Stewart authored
- Change format of DAOD output filename to match grid expectations * Tag PyJobTransforms-02-03-26 (PyJobTransforms-02-03-26)
-