Broken mv in Task (FitDiagnostics)
The FitDiagnostics
task [1] fails, when it tries to move the default root files to the output locations.
The command:
law run FitDiagnostics --version prod23 --datacards /eos/user/m/mfackeld/DiHiggs/store/bbww_sl/Run2_pp_13TeV_2017/DatacardProducer/prod23/tth/nlo/issue_90_001/all_incl_sr_prompt/dnn_score_max/datacard.txt --skip-save Toys --custom-args "--ignoreCovWarning --skipSBFit"
fails with:
mv: cannot stat ‘higgsCombineTest.FitDiagnostics.mH125.123456.root’: No such file or directory
done (took 1 hour, 24 minutes, 8.4 seconds)
ERROR: luigi-interface - [pid 3064] Worker Worker(salt=027663371, workers=1, host=lxplus784.cern.ch, username=dnoll, pid=3064) failed FitDiagnostics(branch=0, version=prod23, custom_args=--ignoreCovWar
ning --skipSBFit, hh_model=HHModelPinv.model_default, datacards=hash:798e002655, mass=125.0, parameter_values=, frozen_parameters=, frozen_groups=, unblinded=False, pois=r, skip_b_only=True, skip_save=Toy
s)
Traceback (most recent call last):
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/data/software/lib/python2.7/site-packages/luigi/worker.py", line 199, in run
new_deps = self._run_get_new_deps()
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/data/software/lib/python2.7/site-packages/luigi/worker.py", line 141, in _run_get_new_deps
task_gen = self.task.run()
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/modules/law/law/decorator.py", line 237, in wrapper
return decorator(fn, _opts, *args, **kwargs)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/modules/law/law/decorator.py", line 263, in log
return fn(task, *args, **kwargs)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/modules/law/law/decorator.py", line 224, in wrapper
result = call(state)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/modules/law/law/decorator.py", line 379, in call
return fn(task, *args, **kwargs)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/modules/law/law/decorator.py", line 224, in wrapper
result = call(state)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/modules/law/law/decorator.py", line 294, in call
return fn(task, *args, **kwargs)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/dhi/tasks/base.py", line 461, in run
self.run_command(cmd, **kwargs)
File "/afs/cern.ch/user/d/dnoll/work/physik/hh/inference/dhi/tasks/base.py", line 443, in run_command
raise Exception("command failed with exit code {}: {}".format(p.returncode, cmd))
Exception: command failed with exit code 1: combine -M FitDiagnostics /eos/user/d/dnoll/dhi/store/CreateWorkspace/HHModelPinv__model_default/datacards_798e002655/m125.0/prod23/workspace.root --verbose 1 --mass 125.0 --toys -1 --redefineSignalPOIs r --setParameters r=1.0,r_qqhh=1.0,r_gghh=1.0,r_vhh=1.0,kl=1.0,kt=1.0,CV=1.0,C2V=1.0 --freezeParameters r_qqhh,r_gghh,r_vhh,kl,kt,CV,C2V --freezeNuisanceGroups "" --skipBOnlyFit --saveShapes --saveWithUncertainties --saveNormalizations --saveWorkspace --saveNLL --saveOverallShapes --cminDefaultMinimizerType Minuit2 --cminDefaultMinimizerStrategy 0 --cminFallbackAlgo Minuit2,0:1.0 --ignoreCovWarning --skipSBFit && mv higgsCombineTest.FitDiagnostics.mH125.123456.root /eos/user/d/dnoll/dhi/store/FitDiagnostics/HHModelPinv__model_default/datacards_798e002655/m125.0/poi_r/prod23/result__poi_r__params_r1.0_r_qqhh1.0_r_gghh1.0_r_vhh1.0_kl1.0_kt1.0_CV1.0_C2V1.0__noToys.root && mv fitDiagnosticsTest.root /eos/user/d/dnoll/dhi/store/FitDiagnostics/HHModelPinv__model_default/datacards_798e002655/m125.0/poi_r/prod23/fitdiagnostics__poi_r__params_r1.0_r_qqhh1.0_r_gghh1.0_r_vhh1.0_kl1.0_kt1.0_CV1.0_C2V1.0__noToys.root
It seems like one of the root files is not present.
I suspect, that higgsCombineTest.FitDiagnostics.mH{self.mass_int}.123456.root
has to be renamed to higgsCombineTest.FitDiagnostics.mH{self.mass_int}.root
I will check this and report back.
In any case, shouldn't the mv
be done by a post_run_command
?
Edited by Dennis Noll