After installing latest jaxlib package, conda list indicates jax-cuda12-pjrt and jax-cuda12-plugin as pypi installed packages

[traversaro]

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

If I install conda create -n jaxcuda jax "jaxlib==*=*cuda*", in conda list the jax-cuda12-pjrt and jax-cuda12-plugin are indicated as packages installed by pypi, even if they are actually one of the three python packages installed by the jaxlib conda package:

jax                       0.4.35             pyhd8ed1ab_1    conda-forge
jax-cuda12-pjrt           0.4.34                   pypi_0    pypi
jax-cuda12-plugin         0.4.34                   pypi_0    pypi
jaxlib                    0.4.34          cuda126py313h25ec20c_201    conda-forge

I noticed that pip list --verbose | grep jax does not indicate the installation method of jaxlib, jax-cuda12-pjrt and jax-cuda12-plugin, so I guess it could be related:

(jax2) traversaro@IITBMP014LW012:~$ pip list --verbose | grep jax
importlib_metadata 8.5.0   /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
jax                0.4.35  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
jax-cuda12-pjrt    0.4.34  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages
jax-cuda12-plugin  0.4.34  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages
jaxlib             0.4.34  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages
ml-dtypes          0.5.0   /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
numpy              2.2.0   /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
opt_einsum         3.4.0   /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
pip                24.3.1  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
scipy              1.14.1  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda
zipp               3.21.0  /home/traversaro/miniforge3/envs/jax2/lib/python3.13/site-packages conda

manually adding a file named "INSTALLER" with content conda in the package metadata fixes the pip list --verbose output, but not the conda list output.

Installed packages

(jax2) traversaro@IITBMP014LW012:~$ conda list
# packages in environment at /home/traversaro/miniforge3/envs/jax2:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
bzip2                     1.0.8                h4bc722e_7    conda-forge
c-ares                    1.34.3               hb9d3cd8_1    conda-forge
ca-certificates           2024.8.30            hbcca054_0    conda-forge
cuda-cccl_linux-64        12.6.77              ha770c72_0    conda-forge
cuda-crt-dev_linux-64     12.6.85              ha770c72_0    conda-forge
cuda-crt-tools            12.6.85              ha770c72_0    conda-forge
cuda-cudart               12.6.77              h5888daf_0    conda-forge
cuda-cudart-dev_linux-64  12.6.77              h3f2d84a_0    conda-forge
cuda-cudart-static_linux-64 12.6.77              h3f2d84a_0    conda-forge
cuda-cudart_linux-64      12.6.77              h3f2d84a_0    conda-forge
cuda-cupti                12.6.80              hbd13f7d_0    conda-forge
cuda-cupti-dev            12.6.80              h5888daf_0    conda-forge
cuda-nvcc-tools           12.6.85              he02047a_0    conda-forge
cuda-nvrtc                12.6.85              hbd13f7d_0    conda-forge
cuda-nvtx                 12.6.77              hbd13f7d_0    conda-forge
cuda-nvvm-tools           12.6.85              he02047a_0    conda-forge
cuda-version              12.6                 h7480c83_3    conda-forge
cudnn                     9.3.0.75             h3e9b439_1    conda-forge
importlib-metadata        8.5.0              pyha770c72_1    conda-forge
jax                       0.4.35             pyhd8ed1ab_1    conda-forge
jax-cuda12-pjrt           0.4.34                   pypi_0    pypi
jax-cuda12-plugin         0.4.34                   pypi_0    pypi
jaxlib                    0.4.34          cuda126py313h25ec20c_201    conda-forge
ld_impl_linux-64          2.43                 h712a8e2_2    conda-forge
libabseil                 20240722.0      cxx17_h5888daf_1    conda-forge
libblas                   3.9.0           25_linux64_openblas    conda-forge
libcblas                  3.9.0           25_linux64_openblas    conda-forge
libcublas                 12.6.4.1             hbd13f7d_0    conda-forge
libcublas-dev             12.6.4.1             h5888daf_0    conda-forge
libcufft                  11.3.0.4             hbd13f7d_0    conda-forge
libcufft-dev              11.3.0.4             h5888daf_0    conda-forge
libcurand                 10.3.7.77            hbd13f7d_0    conda-forge
libcurand-dev             10.3.7.77            h5888daf_0    conda-forge
libcusolver               11.7.1.2             hbd13f7d_0    conda-forge
libcusolver-dev           11.7.1.2             h5888daf_0    conda-forge
libcusparse               12.5.4.2             hbd13f7d_0    conda-forge
libcusparse-dev           12.5.4.2             h5888daf_0    conda-forge
libexpat                  2.6.4                h5888daf_0    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc                    14.2.0               h77fa898_1    conda-forge
libgcc-ng                 14.2.0               h69a702a_1    conda-forge
libgfortran               14.2.0               h69a702a_1    conda-forge
libgfortran5              14.2.0               hd5240d6_1    conda-forge
libgomp                   14.2.0               h77fa898_1    conda-forge
libgrpc                   1.65.5               hf5c653b_0    conda-forge
liblapack                 3.9.0           25_linux64_openblas    conda-forge
liblzma                   5.6.3                hb9d3cd8_1    conda-forge
libmpdec                  4.0.0                h4bc722e_0    conda-forge
libnvjitlink              12.6.85              hbd13f7d_0    conda-forge
libopenblas               0.3.28          pthreads_h94d23a6_1    conda-forge
libprotobuf               5.27.5               h5b01275_2    conda-forge
libre2-11                 2024.07.02           hbbce691_1    conda-forge
libsqlite                 3.47.2               hee588c1_0    conda-forge
libstdcxx                 14.2.0               hc0a3c3a_1    conda-forge
libuuid                   2.38.1               h0b41bf4_0    conda-forge
libzlib                   1.3.1                hb9d3cd8_2    conda-forge
ml_dtypes                 0.5.0           py313ha87cce1_0    conda-forge
nccl                      2.23.4.1             h2b5d15b_3    conda-forge
ncurses                   6.5                  he02047a_1    conda-forge
numpy                     2.2.0           py313hb30382a_0    conda-forge
openssl                   3.4.0                hb9d3cd8_0    conda-forge
opt-einsum                3.4.0                hd8ed1ab_1    conda-forge
opt_einsum                3.4.0              pyhd8ed1ab_1    conda-forge
pip                       24.3.1             pyh145f28c_0    conda-forge
python                    3.13.1          ha99a958_102_cp313    conda-forge
python_abi                3.13                    5_cp313    conda-forge
re2                       2024.07.02           h77b4e00_1    conda-forge
readline                  8.2                  h8228510_1    conda-forge
scipy                     1.14.1          py313h27c5614_2    conda-forge
tk                        8.6.13          noxft_h4845f30_101    conda-forge
tzdata                    2024b                hc8b5060_0    conda-forge
zipp                      3.21.0             pyhd8ed1ab_1    conda-forge

Environment info

(jax2) traversaro@IITBMP014LW012:~$ conda info

     active environment : jax2
    active env location : /home/traversaro/miniforge3/envs/jax2
            shell level : 1
       user config file : /home/traversaro/.condarc
 populated config files : /home/traversaro/miniforge3/.condarc
                          /home/traversaro/.condarc
          conda version : 24.7.1
    conda-build version : not installed
         python version : 3.10.14.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=skylake
                          __conda=24.7.1=0
                          __cuda=12.3=0
                          __glibc=2.39=0
                          __linux=5.15.167.4=0
                          __unix=0=0
       base environment : /home/traversaro/miniforge3  (writable)
      conda av data dir : /home/traversaro/miniforge3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/robostack-staging/linux-64
                          https://conda.anaconda.org/robostack-staging/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /home/traversaro/miniforge3/pkgs
                          /home/traversaro/.conda/pkgs
       envs directories : /home/traversaro/miniforge3/envs
                          /home/traversaro/.conda/envs
               platform : linux-64
             user-agent : conda/24.7.1 requests/2.31.0 CPython/3.10.14 Linux/5.15.167.4-microsoft-standard-WSL2 ubuntu/24.04.1 glibc/2.39 solver/libmamba conda-libmamba-solver/24.1.0 libmambapy/1.5.10
                UID:GID : 1002:1002
             netrc file : None
           offline mode : False

[traversaro]

A similar case is the opencv package that contains the opencv-python and opencv-python-headless python packages, but in that case this two packages are not listed under pypi in conda list.

[traversaro]

The related conda code is https://github.com/conda/conda/blob/e39299d662d68f3e48e0a3f7b702996543bc0994/conda/core/prefix_data.py#L307-L348 .

[traversaro]

pixi list is not affected by the problem.