O2 build fails on: xjalienfs - ubuntu 20.04, possible setuptools issue

mconcas · March 10, 2022, 9:50am

alidist @ “datadist: bump to v1.3.3 (#3923)” 80a3fe3c9806a1022d4ffa1e7c6df06fb86badf8
O2 @ “Revert “Merge pull request #8275 from matthias-kleiner/dedxdev”” 3a1dd5c7b4002e79a54a7efcc80856b73b90f89b

Build breaks at xjalienfs with log:

mconcas@ali47xl:~/alice/latest$ cat /data1/alice/latest/sw/BUILD/xjalienfs-latest/log
++ PIPOPTION=--user
++ '[' '!' X = X ']'
++ env PYTHONUSERBASE=/data1/alice/latest/sw/INSTALLROOT/77c1903180e968a10b191183909a4ab23906ef85/ubuntu2004_x86-64/xjalienfs/1.3.7-local1 ALIBUILD=1 python3 -m pip install --ignore-installed --user file:///data1/alice/latest/sw/SOURCES/xjalienfs/1.3.7/1.3.7
Processing /data1/alice/latest/sw/SOURCES/xjalienfs/1.3.7/1.3.7
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/data1/alice/latest/sw/SOURCES/xjalienfs/1.3.7/1.3.7/setup.py", line 33, in <module>
          setuptools.setup(
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/__init__.py", line 155, in setup
          return distutils.core.setup(**attrs)
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/_distutils/core.py", line 109, in setup
          _setup_distribution = dist = klass(attrs)
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/dist.py", line 458, in __init__
          _Distribution.__init__(
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/_distutils/dist.py", line 293, in __init__
          self.finalize_options()
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/dist.py", line 850, in finalize_options
          for ep in sorted(loaded, key=by_order):
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/dist.py", line 849, in <lambda>
          loaded = map(lambda e: e.load(), filtered)
        File "/data1/alice/latest/sw/ubuntu2004_x86-64/Python-modules/1.0-9/share/python-modules/lib/python/site-packages/setuptools/_vendor/importlib_metadata/__init__.py", line 196, in load
          return functools.reduce(getattr, attrs, module)
      AttributeError: type object 'Distribution' has no attribute '_finalize_feature_opts'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Similar issues on the web point to Python setuptools version issues.
Checking out alidist back to one commit prior of: “Fix setuptools on Ubuntu 21.10 (#3907)” 4779ac9c10cdbfe5d85b9e23c6b6d7ad6ac27377 works.
Unitil now I reproduced this on two different machines of mines, but I never know with Python if this is on my side rather than an actual issue.

Any hint?

mslupeck · March 10, 2022, 12:22pm

I see the same problem - I didn’t check carefully yet but all built well around 1 week ago on my machine.

Here’s my log for reference:

++ PIPOPTION=--user
++ '[' '!' X = X ']'
++ env PYTHONUSERBASE=/home/ubuntu2004/mss/software/alice/sw/INSTALLROOT/e078361968154d96a9d7e6f454b14eb181c9f053/ubuntu2004_x86-64/xjalienfs/1.3.7-local3 ALIBUILD=1 python3 -m pip install --ignore-installed --user file:///home/ubuntu2004/mss/software/alice/sw/SOURCES/xjalienfs/1.3.7/1.3.7
Processing /home/ubuntu2004/mss/software/alice/sw/SOURCES/xjalienfs/1.3.7/1.3.7
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/home/ubuntu2004/mss/software/alice/sw/SOURCES/xjalienfs/1.3.7/1.3.7/setup.py", line 33, in <module>
          setuptools.setup(
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/__init__.py", line 155, in setup
          return distutils.core.setup(**attrs)
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/_distutils/core.py", line 109, in setup
          _setup_distribution = dist = klass(attrs)
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/dist.py", line 458, in __init__
          _Distribution.__init__(
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/_distutils/dist.py", line 293, in __init__
          self.finalize_options()
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/dist.py", line 850, in finalize_options
          for ep in sorted(loaded, key=by_order):
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/dist.py", line 849, in <lambda>
          loaded = map(lambda e: e.load(), filtered)
        File "/home/ubuntu2004/mss/software/alice/sw/ubuntu2004_x86-64/Python-modules/1.0-local4/share/python-modules/lib/python/site-packages/setuptools/_vendor/importlib_metadata/__init__.py", line 196, in load
          return functools.reduce(getattr, attrs, module)
      AttributeError: type object 'Distribution' has no attribute '_finalize_feature_opts'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

eulisse · March 10, 2022, 8:55pm

Can you check if

fixes the issue?

mslupeck · March 11, 2022, 7:42am

When I used this alidist PR (ktf-patch-30) I’m getting the same error as in CI in github, i.e.

++ unset PYTHONPATH ++ '[' '!' X = X ']' /home/ubuntu2004/mss/software/alice/sw/SPECS/ubuntu2004_x86-64/Python-modules/1.0-local5/Python-modules.sh: line 13: ${PIP39_REQUIREMENTS_$(ARCHITECTURE | tr - _):-$PIP39_REQUIREMENTS}: bad substitution

eulisse · March 11, 2022, 10:19am

Apologies, my bad. Have a look at the updated:

please let’s follow up there.

oschmidt · April 19, 2022, 12:03pm

Hi,

with the current aliBuild v1.11.1 and up to date packages the installation now works for me on my ubuntu 20.04 machine, on which it failed before due to the same error described by Matteo above.

No more workarounds needed.

How is it for the others? Do you still observe the issues with the current software status?