[SPI-2086] Add tensorflow_probability and update cython, iminuit, jax, jaxlib, numpy,...

• pyhf updated to 0.6.3
• numpy updated to 1.22.2
• New numpy requied Cython>=1.29.24 (https://github.com/numpy/numpy/blob/main/setup.py#L261) -> Updated Cython to 1.29.28
• scipy updated to 1.8.0
• iminuit updated to 2.9.0
• tensorflow was already updated recently
• tensorflow-probability 0.16.0 added to the stack
• dm_tree (which is a tensorboard-probability requirement: https://github.com/tensorflow/probability/blob/main/required_packages.py#L28) required wrapt>=1.11.2 in requirement-test.txt (https://github.com/deepmind/tree/blob/master/requirements-test.txt) -> wrapt updated to 1.13.3
• jax updated to 0.3.1
• jaxlib updated to 0.3.0
• torch not updated (can do that later)
• uproot updated to 4.2.0
• matplotlib 3.5.1 required some new packages to the stack: https://github.com/matplotlib/matplotlib/blob/v3.5.1/setup.py#L315-L330. Can do this later as well.
• requests is already at 2.27.1, which is the highest available version on PyPi

added test-needed label

Bot test pyhf in dev4 please!

🗩 Build queued

Pyhf build is failing: http://cdash.cern.ch/upload/2824ad45e7d7c3344887f77ce36c4cae5cf91f5e/pyhf-0.6.3-install.log

added test-dev4-failed label

🗩

Release dev4: FAILED

Build ID	Platform	Result
#8309	centos7-gcc11-dbg
#8310	ubuntu20-native-opt
#8311	centos7-clang11-opt
#8312	centos7-gcc8-dbg
#8313	centos7-gcc10-dbg
#8314	centos7-gcc10fp-dbg
#8315	centos7-gcc11-opt
#8316	mac1015-native-opt
#8317	centos7-gcc9-dbg
#8318	centos7-clang11-dbg
#8319	centos7-gcc10fp-opt
#8320	centos7-clang10-dbg
#8321	centos7-gcc9-opt
#8322	centos8-gcc10-dbg
#8323	mac11-native-opt	️
#8324	centos7-clang12-opt
#8325	centos7-gcc8-opt
#8326	centos7-clang10-opt
#8327	centos8-gcc10-opt
#8328	centos7-gcc10-opt

marked this merge request as draft

changed title from Draft: Add tensorflow_probability and update cython, iminuit, jax, jaxlib, numpy,... to Draft: [SPI-2086] Add tensorflow_probability and update cython, iminuit, jax, jaxlib, numpy,...

Bot test pyhf in dev4 please!

🗩 Build queued

Please add some words how the tarball is created as comment in the pyhf recipe somewhere

https://gitlab.cern.ch/sft/lcgcmake/-/blob/45338882300a9b8d0fabdd9f61e6102f0bdd3188/pyexternals/CMakeLists.txt#L5061

Edit: ok, just using the pypi tarball is enough, then nothing special needed

This line

DEPENDS Python setuptools iminuit numpy scipy torch tensorflow jax jaxlib requests matplotlib jsonschema jsonpatch click tqdm uproot uproot3

should also have uproot3 dropped. pyhf's xmlio extra and functionality are now all modern uproot v4.0+ and so don't use uproot3 as a holdover anymore.

added 35 commits

• b008d791...7f9e6bc0 - 33 commits from branch master
• 89888db6 - Add tensorflow_probability and update cython, iminuit, jax, jaxlib, numpy,...
• 90b285b7 - Remove old uproot3 dependency

Compare with previous version

removed test-dev4-failed label

added test-dev4-failed label

🗩

Release dev4: FAILED

Build ID	Platform	Result
#8430	centos7-gcc11-dbg
#8431	ubuntu20-native-opt
#8432	centos7-clang11-opt
#8433	centos7-gcc8-dbg
#8434	centos7-gcc10-dbg
#8435	centos7-gcc10fp-dbg
#8436	centos7-gcc11-opt
#8437	mac1015-native-opt
#8438	centos7-gcc9-dbg
#8439	centos7-clang11-dbg
#8440	centos9-native-dbg
#8441	centos7-gcc10fp-opt
#8442	centos7-clang10-dbg
#8443	centos7-gcc9-opt
#8444	centos8-gcc10-dbg
#8445	mac11-native-opt
#8446	centos7-clang12-opt
#8447	centos7-gcc8-opt
#8448	centos7-clang10-opt
#8449	centos8-gcc10-opt
#8450	centos7-gcc10-opt
#8451	centos9-native-opt

Bot test pyhf in dev4 only centos9-native-opt please!

🗩 Build queued

Bot test pyhf in dev4 only centos9-native-dbg please!

🗩 Build queued

added test-dev4-passed label

🗩

Release dev4: SUCCESS

Build ID	Platform	Result
#8474	centos9-native-opt

🗩

Release dev4: SUCCESS

Build ID	Platform	Result
#8475	centos9-native-dbg

@hahansen anything still missing for this MR? I think we can postpone the torch update?

marked this merge request as ready

Yes, this can be merged

merged

mentioned in commit 8dc62d45

added sweep:ignore label