Skip to content
Snippets Groups Projects
Commit 2c227bf8 authored by Vakhtang Tsulaia's avatar Vakhtang Tsulaia
Browse files

Implemented new interface to Job Transforms for activating MT and MP jobs 

As it was described in the How to run multi-core jobs in production
document, we are introducing two command-line options for the job transform:
	--multithreaded
	--multiprocess

As the names suggest, the former is used for running AthenaMT and the latter
for running AthenaMP. The number of threads/processes is taken from a new
ATHENA_CORE_NUMBER environment.

Now, we have two equivalent ways to run a job in AthenaMT
(Reco_tf is used here as an example):

ATHENA_CORE_NUMBER=N Reco_tf.py --multithreaded [Other Options]
Reco_tf.py --athenaopts=--threads=N [Other Options]

Similarly, for running AthenaMP we have two options:

ATHENA_CORE_NUMBER=N Reco_tf.py	--multiprocess [Other Options]
Reco_tf.py --athenaopts=--nprocs=N [Other Options]

We will get a configuration error from the transform if one of the following occurs:

* ATHENA_PROC_NUMBER was not set but either --multiprocess or --multithreaded was provided
* Both --multiprocess and --multithreaded options were provided to the same job
* --multiprocess was used in combination with either --athenaopts=--nprocs=N or --athenaopts=--threads=N
* --multithreaded was used in combination with --athenaopts=--threads=N or --athenaopts=--nprocs=N

By implementing	these changes we declare the old ATHENA_RPOC_NUMBER environment
obsolete. Athena repository has	been cleaned up	from the dependency on this
environment. The only exception is Generator code, which is yet to be migrated.
parent 7d288c48
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 18 additions and 55 deletions
AtlasTest/AthenaMPTest/test/AthenaMP_Reco_trf_Test.xml
+ 1
− 1
View file @ 2c227bf8
......@@ -17,7 +17,7 @@
<TEST name="SharedPoolReader" type="script" suite="athenamp">
<package_atn>AtlasTest/AthenaMPTest</package_atn>
<options_atn>TRF_ECHO=1 ATHENA_PROC_NUMBER=2 Reco_tf.py '--inputRDOFile' '/afs/cern.ch/atlas/project/rig/referencefiles/MC/valid1.110401.PowhegPythia_P2012_ttbar_nonallhad.e3099_s2578/RDO.04919495._000958.pool.root.1' '--outputESDFile' 'ESD.pool.root' '--autoConfiguration' 'everything' '--maxEvents=4' '--preExec' 'from AthenaMP.AthenaMPFlags import jobproperties as jps' 'jps.AthenaMPFlags.UseSharedReader=True' 'rec.doTrigger=False'</options_atn>
<options_atn>TRF_ECHO=1 ATHENA_CORE_NUMBER=2 Reco_tf.py --multiprocess '--inputRDOFile' '/afs/cern.ch/atlas/project/rig/referencefiles/MC/valid1.110401.PowhegPythia_P2012_ttbar_nonallhad.e3099_s2578/RDO.04919495._000958.pool.root.1' '--outputESDFile' 'ESD.pool.root' '--autoConfiguration' 'everything' '--maxEvents=4' '--preExec' 'from AthenaMP.AthenaMPFlags import jobproperties as jps' 'jps.AthenaMPFlags.UseSharedReader=True' 'rec.doTrigger=False'</options_atn>
<timelimit>30</timelimit>
<author> Vakho Tsulaia </author>
<mailto> tsulaia@cern.ch </mailto>
......
AtlasTest/AthenaMPTest/test/AthenaMP_SimulationTest.xml
+ 4
− 4
View file @ 2c227bf8
......@@ -16,8 +16,8 @@
<TEST name="AtlasG4_tfMP" type="script" suite="AthenaMPSim">
<package_atn>AtlasTest/AthenaMPTest</package_atn>
<doc>Tests MP simulation in TF with ATHENA_PROC_NUMBER</doc>
<options_atn>TRF_ECHO=1 ATHENA_PROC_NUMBER=2 AtlasG4_tf.py --inputEVNTFile '/afs/cern.ch/atlas/offline/ProdData/16.6.X/16.6.7.Y/ttbar_muplusjets-pythia6-7000.evgen.pool.root' --outputHITSFile 'HITSMPSim.pool.root' --maxEvents '4' --skipEvents '0' --randomSeed '10' --geometryVersion 'ATLAS-R2-2015-03-01-00_VALIDATION' --conditionsTag 'OFLCOND-RUN12-SDR-19' --DataRunNumber '222525' --physicsList 'FTFP_BERT' --postInclude 'PyJobTransforms/UseFrontier.py' 'AtlasG4Tf:G4AtlasTests/postInclude.DCubeTest.py' --preExec 'AtlasG4Tf:simFlags.ReleaseGeoModel=False'</options_atn>
<doc>Tests MP simulation in TF</doc>
<options_atn>TRF_ECHO=1 ATHENA_CORE_NUMBER=2 AtlasG4_tf.py --multiprocess --inputEVNTFile '/afs/cern.ch/atlas/offline/ProdData/16.6.X/16.6.7.Y/ttbar_muplusjets-pythia6-7000.evgen.pool.root' --outputHITSFile 'HITSMPSim.pool.root' --maxEvents '4' --skipEvents '0' --randomSeed '10' --geometryVersion 'ATLAS-R2-2015-03-01-00_VALIDATION' --conditionsTag 'OFLCOND-RUN12-SDR-19' --DataRunNumber '222525' --physicsList 'FTFP_BERT' --postInclude 'PyJobTransforms/UseFrontier.py' 'AtlasG4Tf:G4AtlasTests/postInclude.DCubeTest.py' --preExec 'AtlasG4Tf:simFlags.ReleaseGeoModel=False'</options_atn>
<timelimit>30</timelimit>
<author>Vakho Tsulaia</author>
<mailto>tsulaia@cern.ch</mailto>
......@@ -29,7 +29,7 @@
<TEST name="AtlasG4_tfMP-SharedReader" type="script" suite="AthenaMPSimSharedReader">
<package_atn>AtlasTest/AthenaMPTest</package_atn>
<doc>Tests MP simulation in TF with the Shared Reader process</doc>
<options_atn>TRF_ECHO=1 ATHENA_PROC_NUMBER=2 AtlasG4_tf.py --inputEVNTFile '/afs/cern.ch/atlas/offline/ProdData/16.6.X/16.6.7.Y/ttbar_muplusjets-pythia6-7000.evgen.pool.root' --outputHITSFile 'HITSMPSimSharedReader.pool.root' --maxEvents '4' --skipEvents '0' --randomSeed '10' --geometryVersion 'ATLAS-R2-2015-03-01-00_VALIDATION' --conditionsTag 'OFLCOND-RUN12-SDR-19' --DataRunNumber '222525' --physicsList 'FTFP_BERT' --postInclude 'PyJobTransforms/UseFrontier.py' 'AtlasG4Tf:G4AtlasTests/postInclude.DCubeTest.py' --preExec 'AtlasG4Tf:simFlags.ReleaseGeoModel=False;from AthenaMP.AthenaMPFlags import jobproperties as jps;jps.AthenaMPFlags.UseSharedReader=True'</options_atn>
<options_atn>TRF_ECHO=1 ATHENA_CORE_NUMBER=2 AtlasG4_tf.py --multiprocess --inputEVNTFile '/afs/cern.ch/atlas/offline/ProdData/16.6.X/16.6.7.Y/ttbar_muplusjets-pythia6-7000.evgen.pool.root' --outputHITSFile 'HITSMPSimSharedReader.pool.root' --maxEvents '4' --skipEvents '0' --randomSeed '10' --geometryVersion 'ATLAS-R2-2015-03-01-00_VALIDATION' --conditionsTag 'OFLCOND-RUN12-SDR-19' --DataRunNumber '222525' --physicsList 'FTFP_BERT' --postInclude 'PyJobTransforms/UseFrontier.py' 'AtlasG4Tf:G4AtlasTests/postInclude.DCubeTest.py' --preExec 'AtlasG4Tf:simFlags.ReleaseGeoModel=False;from AthenaMP.AthenaMPFlags import jobproperties as jps;jps.AthenaMPFlags.UseSharedReader=True'</options_atn>
<timelimit>30</timelimit>
<author>Vakho Tsulaia</author>
<mailto>tsulaia@cern.ch</mailto>
......@@ -41,7 +41,7 @@
<TEST name="DigiTfPileUpMP" type="script" suite="AthenaMPDigi">
<package_atn>AtlasTest/AthenaMPTest</package_atn>
<doc>Tests MP pile-up digitization</doc>
<options_atn>ATHENA_PROC_NUMBER=4 Digi_tf.py @/afs/cern.ch/user/t/tsulaia/public/DigiTfPileUpMP/HitsFile --conditionsTag default:OFLCOND-RUN12-SDR-25 --digiSeedOffset1 170 --digiSeedOffset2 170 --geometryVersion ATLAS-R2-2015-03-01-00 @/afs/cern.ch/user/t/tsulaia/public/DigiTfPileUpMP/HighPtMinbiasHitsFile @/afs/cern.ch/user/t/tsulaia/public/DigiTfPileUpMP/LowPtMinbiasHitsFile --jobNumber 1 --maxEvents 12 --numberOfCavernBkg 0 --numberOfHighPtMinBias 0.12268057 --numberOfLowPtMinBias 39.8773194 --outputRDOFile mc15_2015_ttbar.RDO.pool.root --postExec 'all:CfgMgr.MessageSvc().setError+=["HepMcParticleLink"]' 'HITtoRDO:from AthenaCommon.CfgGetter import getPublicTool;getPublicTool("MergeMcEventCollTool").OnlySaveSignalTruth=True;ToolSvc.LArAutoCorrTotalToolDefault.deltaBunch=1' --postInclude 'default:PyJobTransforms/UseFrontier.py' --pileupFinalBunch 6 --preExec 'all:from AthenaCommon.BeamFlags import jobproperties;jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0);from LArROD.LArRODFlags import larRODFlags;larRODFlags.NumberOfCollisions.set_Value_and_Lock(20);larRODFlags.nSamples.set_Value_and_Lock(4);larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True);larRODFlags.firstSample.set_Value_and_Lock(0);larRODFlags.useHighestGainAutoCorr.set_Value_and_Lock(True)' --preInclude 'HITtoRDO:Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrainsMC15_2015_25ns_Config1.py,RunDependentSimData/configLumi_run222525_v1.py' --skipEvents 0</options_atn>
<options_atn>ATHENA_CORE_NUMBER=4 Digi_tf.py @/afs/cern.ch/user/t/tsulaia/public/DigiTfPileUpMP/HitsFile --multiproces --conditionsTag default:OFLCOND-RUN12-SDR-25 --digiSeedOffset1 170 --digiSeedOffset2 170 --geometryVersion ATLAS-R2-2015-03-01-00 @/afs/cern.ch/user/t/tsulaia/public/DigiTfPileUpMP/HighPtMinbiasHitsFile @/afs/cern.ch/user/t/tsulaia/public/DigiTfPileUpMP/LowPtMinbiasHitsFile --jobNumber 1 --maxEvents 12 --numberOfCavernBkg 0 --numberOfHighPtMinBias 0.12268057 --numberOfLowPtMinBias 39.8773194 --outputRDOFile mc15_2015_ttbar.RDO.pool.root --postExec 'all:CfgMgr.MessageSvc().setError+=["HepMcParticleLink"]' 'HITtoRDO:from AthenaCommon.CfgGetter import getPublicTool;getPublicTool("MergeMcEventCollTool").OnlySaveSignalTruth=True;ToolSvc.LArAutoCorrTotalToolDefault.deltaBunch=1' --postInclude 'default:PyJobTransforms/UseFrontier.py' --pileupFinalBunch 6 --preExec 'all:from AthenaCommon.BeamFlags import jobproperties;jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0);from LArROD.LArRODFlags import larRODFlags;larRODFlags.NumberOfCollisions.set_Value_and_Lock(20);larRODFlags.nSamples.set_Value_and_Lock(4);larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True);larRODFlags.firstSample.set_Value_and_Lock(0);larRODFlags.useHighestGainAutoCorr.set_Value_and_Lock(True)' --preInclude 'HITtoRDO:Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrainsMC15_2015_25ns_Config1.py,RunDependentSimData/configLumi_run222525_v1.py' --skipEvents 0</options_atn>
<timelimit>30</timelimit>
<author>Vakho Tsulaia</author>
<mailto>tsulaia@cern.ch</mailto>
......
Control/AthenaCommon/python/AthOptionsParser.py
+ 0
− 9
View file @ 2c227bf8
......@@ -433,15 +433,6 @@ def parse(chk_tcmalloc=True):
# This behavior can be controlled by a flag, if needed
os.environ['LIBC_FATAL_STDERR_']='1'
# overwrite nprovs if ATHENA_PROC_NUMBER is set
envNProcs = os.getenv('ATHENA_PROC_NUMBER')
if envNProcs :
envNProcs = int(envNProcs)
print ("ATHENA_PROC_NUMBER set to ", envNProcs, " will run by default with --nprocs=", envNProcs)
opts.nprocs = envNProcs # enable AthenaMP if >= 1 or == -1
from AthenaCommon.ConcurrencyFlags import jobproperties as jps
jps.ConcurrencyFlags.NumProcs = envNProcs
# for the benefit of PyROOT
if not opts.display and '-b' not in sys.argv:
sys.argv = sys.argv[:1] + ['-b'] + sys.argv[1:]
......
Event/ByteStreamCnvSvc/share/BSEventSelector_test_jobOptions_mp.py
+ 0
− 3
View file @ 2c227bf8
......@@ -4,9 +4,6 @@
#
#==============================================================
# Input
import os
os.environ['ATHENA_PROC_NUMBER']='2'
include( "ByteStreamCnvSvc/BSEventStorageEventSelector_jobOptions.py" )
svcMgr.ByteStreamInputSvc.FullFileName = [ "/afs/cern.ch/atlas/offline/test/daq.m4_combined.0020720.extract.L1TT-b00000010._0001.data" ]
......
Event/ByteStreamCnvSvc/test/pre_mp.sh
+ 1
− 1
View file @ 2c227bf8
export ATHENA_PROC_NUMBER=2
export ATHENA_CORE_NUMBER=2
source ../cmt/setup.sh
InnerDetector/InDetDigitization/SCT_Digitization/CMakeLists.txt
+ 1
− 1
View file @ 2c227bf8
......@@ -43,7 +43,7 @@ atlas_add_component( SCT_Digitization
LINK_LIBRARIES ${ROOT_LIBRARIES} ${Boost_LIBRARIES} ${CLHEP_LIBRARIES} CommissionEvent AthenaBaseComps AthenaKernel PileUpToolsLib Identifier xAODEventInfo GaudiKernel SiDigitization InDetRawData InDetSimEvent HitManagement GeneratorObjects SiPropertiesToolLib InDetIdentifier InDetReadoutGeometry InDetSimData )
atlas_add_test( SCT_DigitizationMT_test
SCRIPT Digi_tf.py --inputHITSFile /cvmfs/atlas-nightlies.cern.ch/repo/data/data-art/DigitizationTests/HITS.04919495._001041.pool.root.1 --conditionsTag default:OFLCOND-RUN12-SDR-25 --digiSeedOffset1 170 --digiSeedOffset2 170 --geometryVersion ATLAS-R2-2015-03-01-00 --DataRunNumber 222525 --outputRDOFile mc15_2015_ttbar.RDO.pool.root --preInclude HITtoRDO:SimulationJobOptions/preInclude.SCTOnlyConfig.py,Digitization/ForceUseOfAlgorithms.py --postInclude Digitization/FixDataDependenciesForMT.py --skipEvents 0 --maxEvents 100 --athenaopts '--threads 10'
SCRIPT Digi_tf.py --inputHITSFile /cvmfs/atlas-nightlies.cern.ch/repo/data/data-art/DigitizationTests/HITS.04919495._001041.pool.root.1 --conditionsTag default:OFLCOND-RUN12-SDR-25 --digiSeedOffset1 170 --digiSeedOffset2 170 --geometryVersion ATLAS-R2-2015-03-01-00 --DataRunNumber 222525 --outputRDOFile mc15_2015_ttbar.RDO.pool.root --preInclude HITtoRDO:SimulationJobOptions/preInclude.SCTOnlyConfig.py,Digitization/ForceUseOfAlgorithms.py --postInclude Digitization/FixDataDependenciesForMT.py --skipEvents 0 --maxEvents 100 --athenaopts=--threads=10
PROPERTIES TIMEOUT 1200
ENVIRONMENT THREADS=10 )
......
InnerDetector/InDetExample/InDetSLHC_Example/test/InDetSLHC_Example_TestConfiguration.xml
+ 3
− 3
View file @ 2c227bf8
......@@ -425,7 +425,7 @@
<jobTransformJobName>chainSimsFCalSLHCRTT</jobTransformJobName>
<jobTransformCmd>
xrdcp root://eosatlas.cern.ch//eos/atlas/atlascerngroupdisk/det-slhc/users/oda/EVNTexample/mc12_14TeV.105204.McAtNloJimmy_AUET2CT10_ttbar_allhad.evgen.EVNT.e2238_tid01485091_00/EVNT.01485091._001049.pool.root.1 .
ATHENA_PROC_NUMBER=3 Sim_tf.py --inputEVNTFile=EVNT.01485091._001049.pool.root.1 --outputHITSFile=SLHCtest.sFCal.HITS.pool.root --maxEvents=6 --skipEvents=0 --randomSeed=10 --preInclude='all:InDetSLHC_Example/preInclude.SLHC.py,InDetSLHC_Example/preInclude.NoTRT.py' --geometryVersion=ATLAS-P2-SFCAL-01-00-00_VALIDATION --conditionsTag=OFLCOND-MC15c-SDR-06 --postInclude='all:InDetSLHC_Example/postInclude.SLHC_Setup.py' --postExec 'sim:ToolSvc.ISF_ParticlePositionFilterDynamic.CheckRegion=[1]' --DataRunNumber 240120
ATHENA_CORE_NUMBER=3 Sim_tf.py --multiprocess --inputEVNTFile=EVNT.01485091._001049.pool.root.1 --outputHITSFile=SLHCtest.sFCal.HITS.pool.root --maxEvents=6 --skipEvents=0 --randomSeed=10 --preInclude='all:InDetSLHC_Example/preInclude.SLHC.py,InDetSLHC_Example/preInclude.NoTRT.py' --geometryVersion=ATLAS-P2-SFCAL-01-00-00_VALIDATION --conditionsTag=OFLCOND-MC15c-SDR-06 --postInclude='all:InDetSLHC_Example/postInclude.SLHC_Setup.py' --postExec 'sim:ToolSvc.ISF_ParticlePositionFilterDynamic.CheckRegion=[1]' --DataRunNumber 240120
</jobTransformCmd>
<group>SLHCFCTTransform</group>
<queue>long</queue>
......@@ -442,7 +442,7 @@
xrdcp root://eosatlas.cern.ch//eos/atlas/atlascerngroupdisk/det-slhc/users/oda/HITSexample/mc15_14TeV.119995.Pythia8_A2MSTW2008LO_minbias_inelastic_low.simul.HITS.e1133_s2638_tid05646683_00/HITS.05646683._000002.pool.root.1 .;
xrdcp root://eosatlas.cern.ch//eos/atlas/atlascerngroupdisk/det-slhc/users/oda/HITSexample/mc15_14TeV.119995.Pythia8_A2MSTW2008LO_minbias_inelastic_low.simul.HITS.e1133_s2638_tid05646683_00/HITS.05646683._000003.pool.root.1 .;
xrdcp root://eosatlas.cern.ch//eos/atlas/atlascerngroupdisk/det-slhc/users/oda/HITSexample/mc15_14TeV.119996.Pythia8_A2MSTW2008LO_minbias_inelastic_high.simul.HITS.e1133_s2638_tid05646691_00/HITS.05646691._000001.pool.root.1 .;
ATHENA_PROC_NUMBER=3 Digi_tf.py --inputHITSFile SLHCtest.sFCal.HITS.pool.root --outputRDOFile SLHCtest.sFCal.RDO.pool.root --LowPtMinbiasHitsFile HITS.05646683._00000[1,2,3].pool.root.1 --numberOfLowPtMinBias 199.3040 --HighPtMinbiasHitsFile HITS.05646691._000001.pool.root.1 --numberOfHighPtMinBias 0.69064 --conditionsTag OFLCOND-MC15c-SDR-06 --geometryVersion ATLAS-P2-SFCAL-01-00-00 --DataRunNumber 240120 --pileupFinalBunch 6 --preInclude 'all:InDetSLHC_Example/preInclude.SLHC.py,InDetSLHC_Example/preInclude.NoTRT.py' 'HITtoRDO:Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrains2012Config1_DigitConfig.py,RunDependentSimData/configLumi_user.py' --postInclude 'all:PyJobTransforms/UseFrontier.py,InDetSLHC_Example/postInclude.SLHC_Setup.py' 'HITtoRDO:InDetSLHC_Example/postInclude.SLHC_Digitization_lowthresh.py' --preExec 'HITtoRDO:from AthenaCommon.BeamFlags import jobproperties; jobproperties.Beam.bunchSpacing=25;from LArROD.LArRODFlags import larRODFlags; larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True);larRODFlags.NumberOfCollisions.set_Value_and_Lock(200);from CaloTools.CaloNoiseFlags import jobproperties;jobproperties.CaloNoiseFlags.FixedLuminosity.set_Value_and_Lock(200.0*1.45/8*50/25);rec.doTrigger.set_Value_and_Lock(False);userRunLumiOverride={"run":240120, "lb":1, "starttstamp":1410120000, "mu":200.0};from Digitization.DigitizationFlags import digitizationFlags;digitizationFlags.overrideMetadata+=["SimLayout","PhysicsList"];digitizationFlags.doInDetNoise.set_Value_and_Lock(False)' --postExec 'HITtoRDO:mergeMcEventCollTool=job.StandardPileUpToolsAlg.PileUpTools["MergeMcEventCollTool"];mergeMcEventCollTool.FirstXing=0;mergeMcEventCollTool.LastXing=0;mergeMcEventCollTool.DoSlimming=False;pixeldigi.EnableSpecialPixels=False;CfgMgr.MessageSvc().setError+=["HepMcParticleLink"];conddb.addOverride("/LAR/Identifier/OnOffIdMap","LARIdentifierOnOffIdMap-SFCAL-000");conddb.addOverride("/LAR/Identifier/CalibIdMap","LARIdentifierCalibIdMap-SFCAL-000")' --skipEvents 0 --maxEvents 2 --digiSeedOffset1 50100 --digiSeedOffset2 50122 --jobNumber 123 --ignorePatterns 'ALL ,LArTTCellMap , ERROR .*'
ATHENA_CORE_NUMBER=3 Digi_tf.py --multiprocess --inputHITSFile SLHCtest.sFCal.HITS.pool.root --outputRDOFile SLHCtest.sFCal.RDO.pool.root --LowPtMinbiasHitsFile HITS.05646683._00000[1,2,3].pool.root.1 --numberOfLowPtMinBias 199.3040 --HighPtMinbiasHitsFile HITS.05646691._000001.pool.root.1 --numberOfHighPtMinBias 0.69064 --conditionsTag OFLCOND-MC15c-SDR-06 --geometryVersion ATLAS-P2-SFCAL-01-00-00 --DataRunNumber 240120 --pileupFinalBunch 6 --preInclude 'all:InDetSLHC_Example/preInclude.SLHC.py,InDetSLHC_Example/preInclude.NoTRT.py' 'HITtoRDO:Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrains2012Config1_DigitConfig.py,RunDependentSimData/configLumi_user.py' --postInclude 'all:PyJobTransforms/UseFrontier.py,InDetSLHC_Example/postInclude.SLHC_Setup.py' 'HITtoRDO:InDetSLHC_Example/postInclude.SLHC_Digitization_lowthresh.py' --preExec 'HITtoRDO:from AthenaCommon.BeamFlags import jobproperties; jobproperties.Beam.bunchSpacing=25;from LArROD.LArRODFlags import larRODFlags; larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True);larRODFlags.NumberOfCollisions.set_Value_and_Lock(200);from CaloTools.CaloNoiseFlags import jobproperties;jobproperties.CaloNoiseFlags.FixedLuminosity.set_Value_and_Lock(200.0*1.45/8*50/25);rec.doTrigger.set_Value_and_Lock(False);userRunLumiOverride={"run":240120, "lb":1, "starttstamp":1410120000, "mu":200.0};from Digitization.DigitizationFlags import digitizationFlags;digitizationFlags.overrideMetadata+=["SimLayout","PhysicsList"];digitizationFlags.doInDetNoise.set_Value_and_Lock(False)' --postExec 'HITtoRDO:mergeMcEventCollTool=job.StandardPileUpToolsAlg.PileUpTools["MergeMcEventCollTool"];mergeMcEventCollTool.FirstXing=0;mergeMcEventCollTool.LastXing=0;mergeMcEventCollTool.DoSlimming=False;pixeldigi.EnableSpecialPixels=False;CfgMgr.MessageSvc().setError+=["HepMcParticleLink"];conddb.addOverride("/LAR/Identifier/OnOffIdMap","LARIdentifierOnOffIdMap-SFCAL-000");conddb.addOverride("/LAR/Identifier/CalibIdMap","LARIdentifierCalibIdMap-SFCAL-000")' --skipEvents 0 --maxEvents 2 --digiSeedOffset1 50100 --digiSeedOffset2 50122 --jobNumber 123 --ignorePatterns 'ALL ,LArTTCellMap , ERROR .*'
</jobTransformCmd>
<group>SLHCFCTTransform</group>
<chaindataset_info>
......@@ -463,7 +463,7 @@
<doc>SLHCReconstruction</doc>
<jobTransformJobName>chainRecosFCalSLHCRTT</jobTransformJobName>
<jobTransformCmd>
ATHENA_PROC_NUMBER=3 Reco_tf.py --inputRDOFile SLHCtest.sFCal.RDO.pool.root --outputESDFile SLHCtest.sFCal.ESD.pool.root --outputAODFile SLHCtest.sFCal.AOD.pool.root --geometryVersion 'all:ATLAS-P2-SFCAL-01-00-00' --conditionsTag 'all:OFLCOND-MC15c-SDR-06' --preInclude 'all:InDetSLHC_Example/preInclude.SLHC.NoTRT.Reco.py' --postInclude 'all:PyJobTransforms/UseFrontier.py,InDetSLHC_Example/postInclude.SLHC_Setup.py' 'RAWtoESD:InDetSLHC_Example/postInclude.DigitalClustering.py' --preExec 'all:from CaloTools.CaloNoiseFlags import jobproperties; jobproperties.CaloNoiseFlags.FixedLuminosity.set_Value_and_Lock(200.0*1.45/8*50/25)' --postExec 'all:from IOVDbSvc.CondDB import conddb;conddb.addOverride("/LAR/Identifier/OnOffIdMap","LARIdentifierOnOffIdMap-SFCAL-000");conddb.addOverride("/LAR/Identifier/CalibIdMap","LARIdentifierCalibIdMap-SFCAL-000")' 'RAWtoESD:xAODMaker__xAODTruthCnvAlg("GEN_AOD2xAOD",WriteInTimePileUpTruth=True)' --ignorePatterns 'ALL ,LArTTCellMap , ERROR .*'
ATHENA_CORE_NUMBER=3 Reco_tf.py --multiprocess --inputRDOFile SLHCtest.sFCal.RDO.pool.root --outputESDFile SLHCtest.sFCal.ESD.pool.root --outputAODFile SLHCtest.sFCal.AOD.pool.root --geometryVersion 'all:ATLAS-P2-SFCAL-01-00-00' --conditionsTag 'all:OFLCOND-MC15c-SDR-06' --preInclude 'all:InDetSLHC_Example/preInclude.SLHC.NoTRT.Reco.py' --postInclude 'all:PyJobTransforms/UseFrontier.py,InDetSLHC_Example/postInclude.SLHC_Setup.py' 'RAWtoESD:InDetSLHC_Example/postInclude.DigitalClustering.py' --preExec 'all:from CaloTools.CaloNoiseFlags import jobproperties; jobproperties.CaloNoiseFlags.FixedLuminosity.set_Value_and_Lock(200.0*1.45/8*50/25)' --postExec 'all:from IOVDbSvc.CondDB import conddb;conddb.addOverride("/LAR/Identifier/OnOffIdMap","LARIdentifierOnOffIdMap-SFCAL-000");conddb.addOverride("/LAR/Identifier/CalibIdMap","LARIdentifierCalibIdMap-SFCAL-000")' 'RAWtoESD:xAODMaker__xAODTruthCnvAlg("GEN_AOD2xAOD",WriteInTimePileUpTruth=True)' --ignorePatterns 'ALL ,LArTTCellMap , ERROR .*'
</jobTransformCmd>
<group>SLHCFCTTransform</group>
<chaindataset_info>
......
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_jpsi_no_pileup.sh
+ 0
− 1
View file @ 2c227bf8
......@@ -44,7 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.424100.Pythia8B_A14_CTEQ6L1_Jpsimu4mu4_no_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_jpsi_with_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.424100.Pythia8B_A14_CTEQ6L1_Jpsimu4mu4_with_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_toroid_off.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -30,8 +30,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --conditionsTag RAWtoESD:CONDBR2-BLKPA-2017-12 --geometryVersion ATLAS-R2-2016-01-00-01 --inputBSFile=${infile} --outputAODFile=MuonToroidOff_Reco.AOD.pool.root --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -40,4 +38,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_ttbar_no_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad_no_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_ttbar_with_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad_with_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_z_no_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.361107.PowhegPythia8EvtGen_AZNLOCTEQ6L1_Zmumu_no_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_z_with_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.361107.PowhegPythia8EvtGen_AZNLOCTEQ6L1_Zmumu_with_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_zprime_no_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.361405.Sherpa_CT10_Zmumu_Pt280_500_CVetoBVeto_no_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
MuonSpectrometer/MuonValidation/MuonRecValidation/MuonRecRTT/test/test_muonrecrtt_zprime_with_pileup.sh
+ 1
− 3
View file @ 2c227bf8
......@@ -44,8 +44,6 @@ case $ArtProcess in
infile="../${file[${ArtProcess}]}"
echo "Processing files: " ${infile}
unset ATHENA_NUM_PROC
unset ATHENA_PROC_NUMBER
Reco_tf.py --maxEvents=-1 --inputRDOFile=${infile} --outputAODFile=valid1.361405.Sherpa_CT10_Zmumu_Pt280_500_CVetoBVeto_with_pileup.AOD.pool.root $ValOption --preExec 'from RecExConfig.RecFlags import rec; rec.doTrigger=False; import MuonCombinedRecExample.MuonCombinedRecOnlySetup' --postExec 'r2e:topSequence.BeamBackgroundFiller.Enable = False'
......@@ -54,4 +52,4 @@ case $ArtProcess in
rm -f tmp.ESD
rm -f core.*
;;
esac
\ No newline at end of file
esac
Reconstruction/RecExample/RecExRecoTest/test/test_recexreco_art_calotopoclustering_fromesd_MT_twoThreads.sh
+ 0
− 2
View file @ 2c227bf8
......@@ -5,8 +5,6 @@
# art-include: master/Athena
# art-athena-mt: 4
unset ATHENA_PROC_NUMBER
art.py createpoolfile
athena --threads=2 RecExRecoTest/RecExRecoTest_ART_caloTopoClustering_fromESD.py | tee temp.log
......
Reconstruction/RecExample/RecExRecoTest/test/test_recexreco_art_egamma_fromesd_MT_twoThreads.sh
+ 0
− 2
View file @ 2c227bf8
......@@ -5,8 +5,6 @@
# art-include: master/Athena
# art-athena-mt: 4
unset ATHENA_PROC_NUMBER
art.py createpoolfile
athena --threads=2 RecExRecoTest/RecExRecoTest_ART_egamma_fromESD.py | tee temp.log
......
Reconstruction/RecExample/RecExRecoTest/test/test_recexreco_art_muons_fromesd_MT_twoThreads.sh
+ 0
− 2
View file @ 2c227bf8
......@@ -5,8 +5,6 @@
# art-include: master/Athena
# art-athena-mt: 4
unset ATHENA_PROC_NUMBER
art.py createpoolfile
athena --threads=2 RecExRecoTest/RecExRecoTest_ART_muons_fromESD.py | tee temp.log
......
Reconstruction/RecExample/RecExRecoTest/test/test_recexreco_art_noalgs_fromesd_MT_twoThreads.sh
+ 0
− 2
View file @ 2c227bf8
......@@ -5,8 +5,6 @@
# art-include: master/Athena
# art-athena-mt: 4
unset ATHENA_PROC_NUMBER
art.py createpoolfile
athena --threads=2 RecExRecoTest/RecExRecoTest_ART_noAlgs_fromESD.py | tee temp.log
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment