Skip to content
Snippets Groups Projects
  1. Aug 05, 2015
    • Graeme Stewart's avatar
      * python/trfArgs.py · 014ee775
      Graeme Stewart authored
      	- Allow --skipEvents to be multi-valued (needed by FTK transforms)
      	* scripts/makeTrfJSONSignatures.py
      	- Skip beamSpotT0_Vertex_tf.py, which is a not a PyJobTransforms transform and causes
      	  an abort when using __import__
      	* test/test_trfArgs.py
      	- Do configureFromJSON test with Athena_tf.py instead of Reco_tf.py (which is
      	  in a different project, this a problem in ATN during full builds)
      	* Tagging PyJobTransforms-02-03-60 (PyJobTransforms-02-03-60)
      
      	* python/trfArgs.py
      	- Allow --skipEvents to be multi-valued (needed by FTK transforms)
      	* scripts/makeTrfJSONSignatures.py
      	- Skip beamSpotT0_Vertex_tf.py, which is a not a PyJobTransforms transform and causes
      	  an abort when using __import__
      	* test/test_trfArgs.py
      	- Do configureFromJSON test with Athena_tf.py instead of Reco_tf.py (which is
      	  in a different project, this a problem in ATN during full builds)
      	* Tagging PyJobTransforms-02-03-60
      
      2015-07-08 Lisa Errenst <lisa.errenst@cern.ch>
      	* python/trfReports.py
      	- add HEPSPEC to machine report. Report version 1.0.5
      
      2015-07-03 Graeme Stewart <graeme.andrew.stewart@cern.ch>
      	* python/transform.py
      	- Refactor handling of end of transform to always try to kill stray children
      	* python/trfArgClasses.py
      	- Move _mergeArgs methog from argAthenaFile to argFile so that argNTUP has access
      	* python/trfArgs.py
      ...
      (Long ChangeLog diff - truncated)
      014ee775
  2. May 17, 2015
    • Graeme Stewart's avatar
      * python/trfArgClasses.py · a59cfdb2
      Graeme Stewart authored
      	- Add new auxiliaryFile property to argFile, signaling that a file should not
      	  be validated or appear in the jobReport
      	* python/trfExe.py
      	- Add memMonitor property to scriptExecutor, that will try to use the external
      	  MemoryMonitor binary to memory monitor the script executor's child process
      	- MemoryMonitor is launched immediately after the scriptExecutor's child process
      	  and the memory summary JSON file parsed afterwards and added to the executor
      	  memory report
      	- Deprecate the perfMonFile property of athenaExecutor and stop parsing any
      	  perfmon outputs
      	- For DBRelease files, dereference all soft links, allowing for use with the
      	  pre-release DBRelease-pcache-current.tar.gz link
      	- Change suffix on multiple-merged outputs after AthenaMP has run to _N (as
      	  expected by PanDA)
      	* python/trfFileUtils.py
      	- Add inpFileInterestingKeys (not yet used)
      	* python/trfReports.py
      	- Update report version number to 1.0.1
      	- Modify top level report 'resource' entry to have entries per executor
      	  with MemoryMonitor summary information and a separate entry for the
      	  transform and its externals
      	- Add machine report information to resource entry, with information
      	  also parsed from /proc/cpuinfo
      	* python/trfUtils.py
      	- Add small debug message when setting up a DBRelease from CVMFS
      	* python/trfValidation.py
      	- Ensure that auxilliary files are never validated
      	* test/test_trfUtilsDBRelease.py
      	- Add new test for DBRelease-pcache-current.tar.gz link
      	* Tag PyJobTransforms-02-03-48 (PyJobTransforms-02-03-48)
      
      	* python/trfArgClasses.py
      	- Add new auxiliaryFile property to argFile, signaling that a file should not
      	  be validated or appear in the jobReport
      	* python/trfExe.py
      	- Add memMonitor property to scriptExecutor, that will try to use the external
      	  MemoryMonitor binary to memory monitor the script executor's child process
      	- MemoryMonitor is launched immediately after the scriptExecutor's child process
      	  and the memory summary JSON file parsed afterwards and added to the executor
      	  memory report
      	- Deprecate the perfMonFile property of athenaExecutor and stop parsing any
      	  perfmon outputs
      	- For DBRelease files, dereference all soft links, allowing for use with the
      	  pre-release DBRelease-pcache-current.tar.gz link
      	- Change suffix on multiple-merged outputs after AthenaMP has run to _N (as
      	  expected by PanDA)
      	* python/trfFileUtils.py
      	- Add inpFileInterestingKeys (not yet used)
      	* python/trfReports.py
      	- Update report version number to 1.0.1
      	- Modify top level report 'resource' entry to have entries per executor
      ...
      (Long ChangeLog diff - truncated)
      a59cfdb2
  3. Jan 19, 2015
    • Graeme Stewart's avatar
      Improved JSON transform signatures; added "group" field; more robust script. · f3e09d81
      Graeme Stewart authored
      New way to elevate std::bad_alloc message to "CATASTROPHE" (level = fatal + 10)
      Improved GetTfCommand.py
      Wider test coverage
      * Tag PyJobTransforms-02-03-37 (PyJobTransforms-02-03-37)
      
      	* Tag PyJobTransforms-02-03-37
      
      2014-12-18  Azzah Alshehri <azzah.aziz.alshehri@cern.ch>
      	* python/trfArgClasses.py
      	- Convert the member variable self._desc in prodsysDescription method to be a local variable.
      	- Pass the argument groups into the json signature so that the AMI can use it to layout arguments sensibly when defining 	tags
      
      2014-12-17 Graeme Stewart <graeme.andrew.stewart@cern.ch>
      	* python/trfArgs.py
      	- Add new argument group 'Metadata'
      	- Add task, job, attempt arguments in metadata group
      	- Make metadata arguments a part of standard transform arguments
      	- Fix missing group for athenaMPMergeTargetSize
      	* test/test_trfValidation.py
      	- Clean up all test logfiles
      
      2014-12-17 Graeme Stewart <graeme.andrew.stewart@cern.ch>
      	* python/transform.py
      	- Small change in startup message
      	* python/trfExe.py
      ...
      (Long ChangeLog diff - truncated)
      f3e09d81
  4. Nov 05, 2014
    • Graeme Stewart's avatar
      * trfExe.py · 8dc71161
      Graeme Stewart authored
      	- Change default option in hybridMerge to be "slow" merging, due
      	to persistent issues with fast merged metadata
      	* trfReports.py
      	- Fix bad reference to _maxMsgLen in python report generator
      	* trfValidation.py
      	- Add file count validation for DAOD merging transform
      	* test_AODMerge_tf.py
      	- Account for metadata 'compression' in metadata value test case
      	* Tag PyJobTransforms-02-03-29 (PyJobTransforms-02-03-29)
      
      	* trfExe.py
      	- Change default option in hybridMerge to be "slow" merging, due
      	to persistent issues with fast merged metadata
      	* trfReports.py
      	- Fix bad reference to _maxMsgLen in python report generator
      	* trfValidation.py
      	- Add file count validation for DAOD merging transform
      	* test_AODMerge_tf.py
      	- Account for metadata 'compression' in metadata value test case
      	* Tag PyJobTransforms-02-03-29
      
      2014-09-19 Graeme Stewart <graeme.andrew.stewart@cern.ch>
          * trfAMI.py
          - Introduce test for 'new transform' and make sure that command line
          arguments are prefixed by "--"
          * trfReport.py
          - Truncate very long error messages in exitMsg
          * trfArgClasses.py
          - Refactor EOS globbing code to improve robustness and error messages
          * Tag PyJobTransforms-02-03-28
      ...
      (Long ChangeLog diff - truncated)
      8dc71161
  5. Sep 19, 2014
    • Graeme Stewart's avatar
      * trfExe.py · 4982836c
      Graeme Stewart authored
              - Change format of DAOD output filename to match
                grid expectations
          * Tag PyJobTransforms-02-03-26 (PyJobTransforms-02-03-26)
      4982836c
Loading