CUDA initialization: Unexpected error from cudaGetDeviceCount() error while trying to install Stable Diffusion on FreeBSD + nvidia driver 570.144

I'm trying to install Stable Diffusion on FreeBSD 14.2 + nvidia driver 570.144,following this tutorial : https://github.com/verm/freebsd-stable-diffusion There Verm used nvidia driver 525 and FreeBSD 13 I presume,but now I'm running FreeBSD 14.2 and the nvidia driver 570.144. This is what I did : # pkg install linux-miniconda-installer # miniconda-installer # bash # source ${BASE_PATH}/etc/profile.d/conda.sh # conda activate (base) # (base) # conda create --name pytorch python=3.10 (base) # conda activate pytorch # pip install torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113 (pytorch) # LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.is_available())' True but with the driver : 570.144 it does not work anymore : (pytorch) marietto# nv-sglrun nvidia-smi /usr/local/lib/libc6-shim/libc6.so: shim init Wed May 21 09:41:54 2025 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 570.144 Driver Version: 570.144 CUDA Version: 12.8 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce GTX 1060 3GB Off | 00000000:01:00.0 On | N/A | | 56% 39C P8 7W / 120W | 279MiB / 3072MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| +-----------------------------------------------------------------------------------------+ [marietto@marietto ~]==> source ./miniconda3//etc/profile.d/conda.sh [marietto@marietto ~]==> conda activate (base) # marietto# conda create --name pytorch python=3.10 /home/marietto/miniconda3/lib/python3.12/site-packages/archspec/cpu/detect.py:290: UserWarning: [Errno 2] No such file or directory: '/proc/cpuinfo' warnings.warn(str(exc)) Retrieving notices: done Channels: - defaults Platform: linux-64 Collecting package metadata (repodata.json): done Solving environment: done ## Package Plan ## environment location: /home/marietto/miniconda3/envs/pytorch added / updated specs: - python=3.10 The following packages will be downloaded: package | build ---------------------------|----------------- python-3.10.16 | he870216_1 26.9 MB setuptools-78.1.1 | py310h06a4308_0 1.7 MB wheel-0.45.1 | py310h06a4308_0 115 KB ------------------------------------------------------------ Total: 28.7 MB The following NEW packages will be INSTALLED: _libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main _openmp_mutex pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu bzip2 pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_6 ca-certificates pkgs/main/linux-64::ca-certificates-2025.2.25-h06a4308_0 ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.40-h12ee557_0 libffi pkgs/main/linux-64::libffi-3.4.4-h6a678d5_1 libgcc-ng pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1 libgomp pkgs/main/linux-64::libgomp-11.2.0-h1234567_1 libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1 libuuid pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0 ncurses pkgs/main/linux-64::ncurses-6.4-h6a678d5_0 openssl pkgs/main/linux-64::openssl-3.0.16-h5eee18b_0 pip pkgs/main/noarch::pip-25.1-pyhc872135_2 python pkgs/main/linux-64::python-3.10.16-he870216_1 readline pkgs/main/linux-64::readline-8.2-h5eee18b_0 setuptools pkgs/main/linux-64::setuptools-78.1.1-py310h06a4308_0 sqlite pkgs/main/linux-64::sqlite-3.45.3-h5eee18b_0 tk pkgs/main/linux-64::tk-8.6.14-h39e8969_0 tzdata pkgs/main/noarch::tzdata-2025b-h04d1e81_0 wheel pkgs/main/linux-64::wheel-0.45.1-py310h06a4308_0 xz pkgs/main/linux-64::xz-5.6.4-h5eee18b_1 zlib pkgs/main/linux-64::zlib-1.2.13-h5eee18b_1 Proceed ([y]/n)? Y Downloading and Extracting Packages: Preparing transaction: done Verifying transaction: done Executing transaction: done # # To activate this environment, use # # $ conda activate pytorch # # To deactivate an active environment, use # # $ conda deactivate marietto# exit (base) [marietto@marietto ~]$ conda activate pytorch Defaulting to user installation because normal site-packages is not writeable Looking in indexes: https://pypi.org/simple , https://download.pytorch.org/whl/cu113 Collecting torch==1.12.1+cu113 Downloading https://download.pytorch.org/whl/cu113/torch-1.12.1%2Bcu113-cp310-cp310-linux_x86_64.whl (1837.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 GB 4.5 MB/s eta 0:00:00 Collecting typing-extensions (from torch==1.12.1+cu113) Downloading typing_extensions-4.13.2-py3-none-any.whl.metadata (3.0 kB) Downloading typing_extensions-4.13.2-py3-none-any.whl (45 kB) Installing collected packages: typing-extensions, torch ━━━━━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━ 1/2 [torch] WARNING: The scripts convert-caffe2-to-onnx, convert-onnx-to-caffe2 and torchrun are installed in '/home/marietto/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. Successfully installed torch-1.12.1+cu113 typing-extensions-4.13.2 (pytorch) [marietto@marietto ~]$ export CUDA_VISIBLE_DEVICES=0,1; (pytorch) [marietto@marietto ~]$ LD_PRELOAD="/mnt/da0p2/CG/Tools/Stable-Diffusion/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.is_available())' /home/marietto/.local/lib/python3.10/site-packages/torch/cuda/__init__.py:83: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 304: OS call failed or operation not supported on this OS (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:109.) return torch._C._cuda_getDeviceCount() > 0 False