Skip to content
Snippets Groups Projects
Forked from atlas / athena
Source project has a limited visibility.
  • Vakhtang Tsulaia's avatar
    2c227bf8
    Implemented new interface to Job Transforms for activating MT and MP jobs · 2c227bf8
    Vakhtang Tsulaia authored
    As it was described in the How to run multi-core jobs in production
    document, we are introducing two command-line options for the job transform:
    	--multithreaded
    	--multiprocess
    
    As the names suggest, the former is used for running AthenaMT and the latter
    for running AthenaMP. The number of threads/processes is taken from a new
    ATHENA_CORE_NUMBER environment.
    
    Now, we have two equivalent ways to run a job in AthenaMT
    (Reco_tf is used here as an example):
    
    ATHENA_CORE_NUMBER=N Reco_tf.py --multithreaded [Other Options]
    Reco_tf.py --athenaopts=--threads=N [Other Options]
    
    Similarly, for running AthenaMP we have two options:
    
    ATHENA_CORE_NUMBER=N Reco_tf.py	--multiprocess [Other Options]
    Reco_tf.py --athenaopts=--nprocs=N [Other Options]
    
    We will get a configuration error from the transform if one of the following occurs:
    
    * ATHENA_PROC_NUMBER was not set but either --multiprocess or --multithreaded was provided
    * Both --multiprocess a...
    2c227bf8
    History
    Implemented new interface to Job Transforms for activating MT and MP jobs
    Vakhtang Tsulaia authored
    As it was described in the How to run multi-core jobs in production
    document, we are introducing two command-line options for the job transform:
    	--multithreaded
    	--multiprocess
    
    As the names suggest, the former is used for running AthenaMT and the latter
    for running AthenaMP. The number of threads/processes is taken from a new
    ATHENA_CORE_NUMBER environment.
    
    Now, we have two equivalent ways to run a job in AthenaMT
    (Reco_tf is used here as an example):
    
    ATHENA_CORE_NUMBER=N Reco_tf.py --multithreaded [Other Options]
    Reco_tf.py --athenaopts=--threads=N [Other Options]
    
    Similarly, for running AthenaMP we have two options:
    
    ATHENA_CORE_NUMBER=N Reco_tf.py	--multiprocess [Other Options]
    Reco_tf.py --athenaopts=--nprocs=N [Other Options]
    
    We will get a configuration error from the transform if one of the following occurs:
    
    * ATHENA_PROC_NUMBER was not set but either --multiprocess or --multithreaded was provided
    * Both --multiprocess a...
Code owners
Assign users and groups as approvers for specific file changes. Learn more.