Installing Anaconda on ZFS filesystem

Dear expert,

I have downloaded Anaconda3-2024.06-1-Linux-x86_64.sh with the goal to install it our compute cluster. We have upgraded it from CentOS 7 to Rocky Linux 9.4 with ZFS 5000. We have made dozens of successful installations of Anaconda on CentOS 7, but in Rocky 9.4 I get:

PREFIX=/trinity/opt/apps/development/Anaconda/2024.06/pcraster
Unpacking payload …
Traceback (most recent call last):
File “entry_point.py”, line 308, in
File “entry_point.py”, line 300, in main
File “entry_point.py”, line 208, in _constructor_subcommand
File “entry_point.py”, line 151, in _constructor_extract_conda_pkgs
File “concurrent/futures/process.py”, line 732, in init
File “concurrent/futures/process.py”, line 173, in init
File “multiprocessing/queues.py”, line 43, in init
File “multiprocessing/context.py”, line 68, in Lock
File “multiprocessing/synchronize.py”, line 169, in init
File “multiprocessing/synchronize.py”, line 57, in init
PermissionError: [Errno 13] Permission denied
[2314369] Failed to execute script ‘entry_point’ due to unhandled exception!
(10:25 lukas@login01 2024.06) >

but when I compile on an ext4 filesystem I had (and still have) no problem.

According to Stackoverflow, this error has occurred in the past with:

  1. Incorrect download, but the md5sum is a nice and clean a590547c03068e1cb3ca731788f48442
  2. Installation on encrypted partition, but the partition is not encrypted.
  3. Out of disk space, but there is 15 TB available.
    4: Out of memory, but there is 74 GB available.

I have tried to access to multiprocessing/synchronize.py, to see what is actually happenening on line 57 that causes the permission denied. However, if I unpack the installer, I only get:

(11:16 lukas@login01 2024.06) > tar -xvf info-_anaconda_depends-2024.06-py312_mkl_2.tar.zst
info/test/run_test.sh
info/paths.json
info/test/run_test.py
info/hash_input.json
info/index.json
info/recipe/conda_build_config.yaml
info/recipe/meta.yaml
info/about.json
info/recipe/parent/header.bmp
info/recipe/parent/meta.yaml
info/recipe/parent/EULA.txt
info/git
info/files
info/recipe/parent/icon.ico
info/recipe/parent/welcome.bmp
(11:16 lukas@login01 2024.06) > tar -xvf pkg-_anaconda_depends-2024.06-py312_mkl_2.tar.zst
info/licenses/EULA.txt

but not the big binary blob that apparently must contain the python script.

We have copied old installations to the new OS, which appear to work, but it would be nice to make fresh installs. In those old installations I checked and found: [install prefix]/lib/python3.11/multiprocessing/synchronize.py, with on line 57:

sl = self._semlock = _multiprocessing.SemLock(
kind, value, maxvalue, self._make_name(),
unlink_now)

I am not really sure what it is trying to do here.

Any hint to point my nose in the correct direction would be greatly appreciated

Thank you for your time and expertise,

Lukas

Update:

It turned out that due to a mistake made while fixing another problem, we accidentally removed /dev/pts and /dev/shm. They have been recovered, and the installations of Anaconda runs smoothy as well.

Still a more indicative error message would have been nice :slight_smile:

For my part, this thread can be considered closed.