Skip to content

virtualenv inside LCG distribution

Tests with LCG_96b (thanks @swertz for the reports) showed a few isues, summarizing:

  • venv creates a pip executable (small wrapper) that's not compatible with the pip module that's actually picked up, so one should use python -m pip instead (see also https://github.com/pypa/pip/issues/5599)
  • building the library that depends on libtorch in !20 (merged) fails because a different version of the torch package is in the distribution than the latest one (which I tested with there)
  • from studying the above: the LCG setup script adds the site packages to PYTHONPATH, which overrides what the virtualenv relies on (such that it's impossible to pick up a more recent package from the virtualenv). Setting the PYTHONHOME to /cvmfs/sft.cern.ch/lcg/views/LCG_96bpython3/x86_64-centos7-gcc8-opt/lib/python3.6, removing some parts of the PYTHONPATH and creating the venv with --system-site-packages seems to swap the order as expected, but doesn't fix the original issue with libtorch yet
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information