5.4 beta fails to install (IDFGH-14208)

[dannybackx]

Answers checklist.

• I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
• I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
• I have searched the issue tracker for a similar issue and not found a similar issue.

IDF version.

5.4beta1 and 5.4beta2

Operating System used.

Linux

How did you build your project?

Command line with idf.py

If you are using Windows, please specify command line type.

None

What is the expected behavior?

Running ". export.sh" as described fails :

danny@victus:~/src/github/esp32/esp-idf-v5.4-beta2$ ./export.sh
Checking "python3" ...
Python 3.10.12
"python3" has been detected
error: Activation script failed
danny@victus:~/src/github/esp32/esp-idf-v5.4-beta2$ . export.sh
Checking "python3" ...
Python 3.10.12
"python3" has been detected
error: Activation script failed

What is the actual behavior?

see above

Steps to reproduce.

See above

Build or installation Logs.

see above

More Information.

works with all 5.3 versions

[dannybackx]

Running install.sh from the 5.3.2 directory restored existing environment to working order.
Installation of the beta also killed that.

[fhrbata]

Hello @dannybackx , can you please try to export ESP_IDF_EXPORT_DEBUG before running the . ./export.sh and post the output? It may help to see what's going on.

export ESP_IDF_EXPORT_DEBUG=1
. ./export.sh

Thank you

[dannybackx]

This doesn't change the output at all.

$ . ./export.sh
Could not detect IDF_PATH. Please set it before sourcing this script:
  export IDF_PATH=(add path here)
$ sh ./install.sh
Detecting the Python interpreter
Checking "python3" ...
Python 3.10.12
"python3" has been detected
Checking Python compatibility
Installing ESP-IDF tools
Updating /home/danny/.espressif/idf-env.json
Selected targets are: esp32c2, esp32c61, esp32c6, esp32c5, esp32p4, esp32s2, esp32h2, esp32s3, esp32, esp32c3
Current system platform: linux-amd64
Installing tools: xtensa-esp-elf-gdb, riscv32-esp-elf-gdb, xtensa-esp-elf, riscv32-esp-elf, esp32ulp-elf, openocd-esp32, esp-rom-elfs
Skipping [email protected]_20240403 (already installed)
Skipping [email protected]_20240403 (already installed)
Skipping [email protected]_20240906 (already installed)
Skipping [email protected]_20240906 (already installed)
Skipping [email protected]_20240113 (already installed)
Skipping [email protected] (already installed)
Skipping esp-rom-elfs@20241011 (already installed)
Installing Python environment and packages
Python 3.10.12
pip 24.3.1 from /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages/pip (python 3.10)
WARNING: The following issue occurred while accessing the ESP-IDF version file in the Python environment: [Errno 2] No such file or directory: '/home/danny/.espressif/python_env/idf5.0_py3.10_env/idf_version.txt'. (Diagnostic information. It can be ignored.)
Skipping the download of /home/danny/.espressif/espidf.constraints.v5.4.txt because it was downloaded recently.
Upgrading pip and setuptools...
Requirement already satisfied: pip in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (24.3.1)
Requirement already satisfied: setuptools in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (71.0.0)
Installing Python packages
 Constraint file: /home/danny/.espressif/espidf.constraints.v5.4.txt
 Requirement files:
  - /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt
Looking in indexes: https://pypi.org/simple, https://dl.espressif.com/pypi
Ignoring importlib_metadata: markers 'python_version < "3.8"' don't match your environment
Requirement already satisfied: setuptools in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 7)) (71.0.0)
Requirement already satisfied: packaging in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 8)) (24.2)
Requirement already satisfied: click in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 11)) (8.1.7)
Requirement already satisfied: pyserial in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 12)) (3.5)
Requirement already satisfied: cryptography in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 13)) (43.0.3)
Requirement already satisfied: pyparsing in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 14)) (3.2.0)
Requirement already satisfied: pyelftools in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 15)) (0.31)
Requirement already satisfied: idf-component-manager in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (2.1.1)
Requirement already satisfied: esp-coredump in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 17)) (1.12.0)
Requirement already satisfied: esptool in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (4.8.1)
Requirement already satisfied: esp-idf-kconfig in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 19)) (2.3.0)
Requirement already satisfied: esp-idf-monitor in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 20)) (1.5.0)
Requirement already satisfied: esp-idf-nvs-partition-gen in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 21)) (0.1.6)
Requirement already satisfied: esp-idf-size in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 22)) (1.6.1)
Requirement already satisfied: esp-idf-panic-decoder in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 23)) (1.2.1)
Requirement already satisfied: pyclang in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 24)) (0.6.0)
Requirement already satisfied: construct in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 25)) (2.10.70)
Requirement already satisfied: rich in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 26)) (13.9.4)
Requirement already satisfied: psutil in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 27)) (6.1.0)
Requirement already satisfied: freertos_gdb in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 30)) (1.0.3)
Requirement already satisfied: cffi>=1.12 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from cryptography->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 13)) (1.16.0)
Requirement already satisfied: colorama in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (0.4.6)
Requirement already satisfied: pyyaml in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (6.0.1)
Requirement already satisfied: ruamel.yaml in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (0.18.6)
Requirement already satisfied: requests in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (2.31.0)
Requirement already satisfied: requests-file in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (1.5.1)
Requirement already satisfied: requests-toolbelt in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (1.0.0)
Requirement already satisfied: tqdm in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (4.66.1)
Requirement already satisfied: jsonref in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (1.1.0)
Requirement already satisfied: pydantic in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (2.8.2)
Requirement already satisfied: pydantic-core in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (2.20.1)
Requirement already satisfied: pydantic-settings in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (2.4.0)
Requirement already satisfied: typing-extensions in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (4.12.2)
Requirement already satisfied: pygdbmi>=0.9.0.2 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esp-coredump->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 17)) (0.9.0.2)
Requirement already satisfied: bitstring!=4.2.0,>=3.1.6 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (4.1.2)
Requirement already satisfied: ecdsa>=0.16.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (0.18.0)
Requirement already satisfied: reedsolo<1.8,>=1.5.3 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (1.7.0)
Requirement already satisfied: intelhex in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (2.3.0)
Requirement already satisfied: argcomplete>=3 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (3.5.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from rich->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 26)) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from rich->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 26)) (2.17.2)
Requirement already satisfied: bitarray<3.0.0,>=2.8.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from bitstring!=4.2.0,>=3.1.6->esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (2.8.1)
Requirement already satisfied: pycparser in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from cffi>=1.12->cryptography->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 13)) (2.21)
Requirement already satisfied: six>=1.9.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from ecdsa>=0.16.0->esptool->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 18)) (1.16.0)
Requirement already satisfied: mdurl~=0.1 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 26)) (0.1.2)
Requirement already satisfied: annotated-types>=0.4.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from pydantic->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (0.7.0)
Requirement already satisfied: python-dotenv>=0.21.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from pydantic-settings->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (1.0.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (3.2.0)
Requirement already satisfied: idna<4,>=2.5 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (1.26.16)
Requirement already satisfied: certifi>=2017.4.17 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (2023.7.22)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from ruamel.yaml->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.4-beta2/tools/requirements/requirements.core.txt (line 16)) (0.2.12)
All done! You can now run:

  . ./export.sh

$   . ./export.sh
Could not detect IDF_PATH. Please set it before sourcing this script:
  export IDF_PATH=(add path here)
$ pwd
/home/danny/src/github/esp32/esp-idf-v5.4-beta2
$ export IDF_PATH=/home/danny/src/github/esp32/esp-idf-v5.4-beta2
$   . ./export.sh
Checking "python3" ...
Python 3.10.12
"python3" has been detected
error: Activation script failed
$ 

and then my 5.3.2 setup was broken again so I fixed it :

victus: {12} cd src/github/esp32/esp-idf-v5.3.2
victus: {13} sh install.sh
Detecting the Python interpreter
Checking "python3" ...
Python 3.10.12
"python3" has been detected
Checking Python compatibility
Installing ESP-IDF tools
Selected targets are: esp32c6, esp32s3, esp32p4, esp32c2, esp32h2, esp32c3, esp32s2, esp32c61, esp32, esp32c5
Current system platform: linux-amd64
Installing tools: xtensa-esp-elf-gdb, riscv32-esp-elf-gdb, xtensa-esp-elf, riscv32-esp-elf, esp32ulp-elf, openocd-esp32, esp-rom-elfs
Skipping [email protected]_20240403 (already installed)
Skipping [email protected]_20240403 (already installed)
Skipping [email protected]_20240530 (already installed)
Skipping [email protected]_20240530 (already installed)
Skipping [email protected]_20240113 (already installed)
Skipping [email protected] (already installed)
Skipping esp-rom-elfs@20240305 (already installed)
Installing Python environment and packages
Python 3.10.12
pip 24.3.1 from /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages/pip (python 3.10)
WARNING: The following issue occurred while accessing the ESP-IDF version file in the Python environment: [Errno 2] No such file or directory: '/home/danny/.espressif/python_env/idf5.0_py3.10_env/idf_version.txt'. (Diagnostic information. It can be ignored.)
Skipping the download of /home/danny/.espressif/espidf.constraints.v5.3.txt because it was downloaded recently.
Upgrading pip and setuptools...
Requirement already satisfied: pip in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (24.3.1)
Requirement already satisfied: setuptools in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (71.0.0)
Installing Python packages
 Constraint file: /home/danny/.espressif/espidf.constraints.v5.3.txt
 Requirement files:
  - /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt
Looking in indexes: https://pypi.org/simple, https://dl.espressif.com/pypi
Ignoring importlib_metadata: markers 'python_version < "3.8"' don't match your environment
Requirement already satisfied: setuptools in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 3)) (71.0.0)
Requirement already satisfied: packaging in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 4)) (24.2)
Requirement already satisfied: click in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 7)) (8.1.7)
Requirement already satisfied: pyserial in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 8)) (3.5)
Collecting cryptography (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 9))
  Using cached https://dl.espressif.com/pypi/cryptography/cryptography-42.0.8-cp39-abi3-manylinux_2_28_x86_64.whl (3.9 MB)
Requirement already satisfied: pyparsing in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 10)) (3.2.0)
Requirement already satisfied: pyelftools in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 11)) (0.31)
Requirement already satisfied: idf-component-manager in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (2.1.1)
Requirement already satisfied: esp-coredump in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 13)) (1.12.0)
Requirement already satisfied: esptool in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (4.8.1)
Requirement already satisfied: esp-idf-kconfig in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 15)) (2.3.0)
Requirement already satisfied: esp-idf-monitor in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 16)) (1.5.0)
Requirement already satisfied: esp-idf-nvs-partition-gen in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 17)) (0.1.6)
Requirement already satisfied: esp-idf-size in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 18)) (1.6.1)
Requirement already satisfied: esp-idf-panic-decoder in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 19)) (1.2.1)
Requirement already satisfied: pyclang in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 20)) (0.6.0)
Requirement already satisfied: construct in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 21)) (2.10.70)
Requirement already satisfied: freertos_gdb in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from -r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 24)) (1.0.3)
Requirement already satisfied: cffi>=1.12 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from cryptography->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 9)) (1.16.0)
Requirement already satisfied: colorama in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (0.4.6)
Requirement already satisfied: pyyaml in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (6.0.1)
Requirement already satisfied: ruamel.yaml in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (0.18.6)
Requirement already satisfied: requests in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (2.31.0)
Requirement already satisfied: requests-file in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (1.5.1)
Requirement already satisfied: requests-toolbelt in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (1.0.0)
Requirement already satisfied: tqdm in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (4.66.1)
Requirement already satisfied: jsonref in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (1.1.0)
Requirement already satisfied: pydantic in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (2.8.2)
Requirement already satisfied: pydantic-core in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (2.20.1)
Requirement already satisfied: pydantic-settings in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (2.4.0)
Requirement already satisfied: typing-extensions in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (4.12.2)
Requirement already satisfied: pygdbmi>=0.9.0.2 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esp-coredump->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 13)) (0.9.0.2)
Requirement already satisfied: bitstring!=4.2.0,>=3.1.6 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (4.1.2)
Requirement already satisfied: ecdsa>=0.16.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (0.18.0)
Requirement already satisfied: reedsolo<1.8,>=1.5.3 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (1.7.0)
Requirement already satisfied: intelhex in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (2.3.0)
Requirement already satisfied: argcomplete>=3 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (3.5.0)
Requirement already satisfied: rich in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from esp-idf-size->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 18)) (13.9.4)
Requirement already satisfied: bitarray<3.0.0,>=2.8.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from bitstring!=4.2.0,>=3.1.6->esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (2.8.1)
Requirement already satisfied: pycparser in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from cffi>=1.12->cryptography->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 9)) (2.21)
Requirement already satisfied: six>=1.9.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from ecdsa>=0.16.0->esptool->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 14)) (1.16.0)
Requirement already satisfied: annotated-types>=0.4.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from pydantic->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (0.7.0)
Requirement already satisfied: python-dotenv>=0.21.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from pydantic-settings->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (1.0.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (3.2.0)
Requirement already satisfied: idna<4,>=2.5 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (1.26.16)
Requirement already satisfied: certifi>=2017.4.17 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from requests->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (2023.7.22)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from rich->esp-idf-size->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 18)) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from rich->esp-idf-size->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 18)) (2.17.2)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from ruamel.yaml->idf-component-manager->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 12)) (0.2.12)
Requirement already satisfied: mdurl~=0.1 in /home/danny/.espressif/python_env/idf5.0_py3.10_env/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich->esp-idf-size->-r /home/danny/src/github/esp32/esp-idf-v5.3.2/tools/requirements/requirements.core.txt (line 18)) (0.1.2)
Installing collected packages: cryptography
  Attempting uninstall: cryptography
    Found existing installation: cryptography 43.0.3
    Uninstalling cryptography-43.0.3:
      Successfully uninstalled cryptography-43.0.3
Successfully installed cryptography-42.0.8
All done! You can now run:

  . ./export.sh

[fhrbata]

Hello @dannybackx,

thank you very much for the extra details. It seems you're executing the install.sh script for v5.4 while "v5.0 or v5.3" is already activated. This can be seen in the log you posted, which shows packages and python virtual environment being set up in /home/danny/.espressif/python_env/idf5.0_py3.10_env/, even for the v5.3 installation. I recommend starting the installation in a new terminal session without any ESP-IDF environment active. I believe it should help to solve the problem.

The issue arises because the export(activate.py) script is looking for the python interpreter in the .espressif/python_env/idf5.4_py3.12_env/bin/python directory not honoring the already set IDF_PYTHON_ENV_PATH environmental variable. This might be a bug that we need to look into.

Thank you

[dannybackx]

That seems to work.
Note that for me this requirement appears new, my installations used to work like this (with an existing IDF environment in place).

[fhrbata]

Hello @dannybackx,

thank you very much for confirming that this solution works for you. Recent versions include a check to prevent overwriting an existing python virtual environment if it was created for a different ESP-IDF version. However, it should still be possible to use IDF_PYTHON_ENV_PATH to specify a custom python virtual environment location. I've submitted a merge request to address this issue.

Thank you!