submit.py suggests merging an uncompleted run when HTCondor is down
I just tried to submit jobs while HTCondor isn't operational.
submit.py
notices that there is an issue with HTCondor and doesn't submit jobs, but then suggests to merge the outputs -- even though there are no outputs yet as this is the first submission with this identifier.
[neundorf@naf-atlas11]~/HeavyNeutrinos/AnalysisCode/run % submit.py --jobs config/jobLists/0nuBB/jobs-nominal.txt --allowArgChanges --identifier cutoutthecenter config/master/0nuBB/analyze-0nuBB.cfg --mergeConfig auxData/submission/merge-0nuBB.cfg
xAOD::Init INFO Environment initialised for data access
INFO: Reading configuration for 'analyze' from file 'config/master/0nuBB/analyze-0nuBB.cfg'
INFO: Successfully parsed as .cfg file
INFO: Reading configuration for 'analyze' from file 'config/aliases/common/aliases-flat.cfg'
INFO: Successfully parsed as .cfg file
INFO: Reading configuration for 'analyze' from file 'config/aliases/ssWW/aliases_ssWW_chargeflip.cfg'
INFO: Successfully parsed as .cfg file
INFO: Reading configuration for 'analyze' from file 'config/aliases/0nuBB/0nuBB-SR.cfg'
INFO: Successfully parsed as .cfg file
INFO: Reading configuration for 'analyze' from file 'fakefactors/0nuBB/fakefactor_list.cfg'
INFO: Successfully parsed as .cfg file
INFO: Reading configuration for 'analyze' from file 'config/aliases/0nuBB/0nuBB.cfg'
INFO: Successfully parsed as .cfg file
INFO: loading sample folder '/nfs/dust/atlas/user/neundorf/HeavyNAnalysis/run/sampleFolders/initialized/samples-initialized-0nuBB.root:samples'
INFO: successfully imported patch tags from 'config/patches/0nuBB/pool.txt'
Failed to get valid response from condor_q, considering current queue to be empty
Queue couldn't be updated. Trying 2 more times.
Failed to get valid response from condor_q, considering current queue to be empty
Queue couldn't be updated. Trying 1 more times.
Failed to get valid response from condor_q, considering current queue to be empty
Queue couldn't be updated. Aborting submission.
INFO: Reading configuration for 'merge' from file 'auxData/submission/merge-0nuBB.cfg'
INFO: Successfully parsed as .cfg file
INFO: All your batch jobs seem to have succeeded and have the status 'done'.
INFO: You can merge them e.g. with:
INFO: tqmerge -t analyze /nfs/dust/atlas/user/neundorf/HeavyNAnalysis/run/batchOutput/unmerged_cutoutthecenter/*.root --output /nfs/dust/atlas/user/neundorf/HeavyNAnalysis/run/sampleFolders/analyzed/samples-analyzed-0nuBB.root --downmerge generalize --patch /afs/desy.de/user/n/neundorf/HeavyNeutrinos/AnalysisCode/ssWWAnalysisCode/share/config/patches/0nuBB/downmerge.txt --patch /afs/desy.de/user/n/neundorf/HeavyNeutrinos/AnalysisCode/ssWWAnalysisCode/share/config/patches/common/trimmingAfterPooling.txt
Done
[neundorf@naf-atlas11]~/HeavyNeutrinos/AnalysisCode/run % condor_submit -i
ERROR: Can't find address of local schedd
1 [neundorf@naf-atlas11]~/HeavyNeutrinos/AnalysisCode/run % ls -lhtr batchOutput/unmerged_cutoutthecenter
total 0
[neundorf@naf-atlas11]~/HeavyNeutrinos/AnalysisCode/run % wc -l ${CAFANALYSISSHARE}/config/jobLists/0nuBB/jobs-nominal.txt
737 /afs/desy.de/user/n/neundorf/HeavyNeutrinos/AnalysisCode/ssWWAnalysisCode/share/config/jobLists/0nuBB/jobs-nominal.txt