Issues with pydevd modules and pycharm remote debugger

[N0K0]

Hi! I have some issues getting the remote debugger up and running. This is a clean Win10 vm with Binja Personal and PyCharm Pro. Clean venv with python3.10

Issue at hand:

[Default] Traceback (most recent call last):
[Default]   File "C:\Users\n\AppData\Roaming\Binary Ninja\plugins\decrypt_string\__init__.py", line 9, in <module>
[Default]     connect_pycharm_debugger()
[Default]   File "C:\Program Files\Vector35\BinaryNinja\plugins\..\python\binaryninja\__init__.py", line 356, in connect_pycharm_debugger
[Default]     import pydevd_pycharm  # type: ignore
[Default]   File "C:\Users\n\AppData\Roaming\Binary Ninja\python310\site-packages\pydevd_pycharm.py", line 3, in <module>
[Default]     from pydevd import settrace
[Default]   File "C:\Users\n\AppData\Roaming\Binary Ninja\python310\site-packages\pydevd.py", line 16, in <module>
[Default]     from _pydevd_bundle.pydevd_collect_try_except_info import collect_return_info
[Default] ModuleNotFoundError: No module named '_pydevd_bundle.pydevd_collect_try_except_info'
[PythonPlugin] Python plugin 'decrypt_string' could not be loaded

Plugin:

from binaryninja import *

from binaryninja.log import log_info


import sys
print(sys.path)

connect_pycharm_debugger()

class DecodeString(binaryninja.Transform):
    name = "Decode String"
    description = "Decode String"
    input_type = "Raw"
    output_type = "Raw"
    transform_type = binaryninja.TransformType.DecodeTransform

    def perform_decode(self, data, params):
        """
        void* rax_2 = HeapAlloc(hHeap: GetProcessHeap(), dwFlags: HEAP_ZERO_MEMORY, dwBytes: sx.q(arg2))
        for (int32_t i = 0; i u< arg2; i = i + 1)
            char var_24_1 = 0x13
            if (modu.dp.d(0:i, 2) == 0)>
                var_24_1 = 0x37
            *(rax_2 + zx.q(i)) = *(arg1 + zx.q(i)) ^ var_24_1
        return rax_2
        """
        log_info("Performing decode")
        result = bytearray()
        for i in range(len(data)):
            if i % 2 == 0:
                result.append(data[i] ^ 0x13)
            else:
                result.append(data[i] ^ 0x37)
        return result

    def perform_encode(self, data, params):
        return self.perform_decode(data, params)


# Register plugin
DecodeString.register()

Preferences:

Pip list:

pip list

Package        Version
-------------- -----------
colorama       0.4.4
pip            23.2.1
pydantic       1.7.3
pydev          0.0.1
pydevd         2.10.0
pydevd-pycharm 211.7142.13
setuptools     68.2.0
wheel          0.41.2

[xusheng6]

I have created an issue #4904 and will look into it

[xusheng6]

Hi @N0K0, did you install the correct version of pydevd-pycharm as suggested here?

binaryninja-api/python/__init__.py

Line 357 in 7df8225

# pip install --user pydevd-pycharm~=211.7142.13

If so, can you check if the file pydevd_collect_try_except_info exists in the right place?

[N0K0]

Setup a new clean venv: Installed the suggested version from the current PyCharm

pip install pydevd-pycharm~=233.13135.95

pip list:

Package        Version
-------------- ------------
pip            23.2.1
pydevd-pycharm 233.13135.95
setuptools     68.2.0
wheel          0.41.2

Traceback:

[Default] Traceback (most recent call last):
[Default]   File "/home/n/.binaryninja/plugins/binary_ninja_plugin/__init__.py", line 1, in <module>
[Default]     from .debug import *
[Default]   File "/home/n/.binaryninja/plugins/binary_ninja_plugin/debug.py", line 4, in <module>
[Default]     binaryninja.connect_pycharm_debugger()
[Default]   File "/opt/binaryninja/plugins/../python/binaryninja/__init__.py", line 356, in connect_pycharm_debugger
[Default]     import pydevd_pycharm  # type: ignore
[Default]     ^^^^^^^^^^^^^^^^^^^^^
[Default]   File "/home/n/git/binary_ninja_plugin/venv/lib/python3.11/site-packages/pydevd_pycharm.py", line 3, in <module>
[Default]     from pydevd import settrace
[Default]   File "/home/n/git/binary_ninja_plugin/venv/lib/python3.11/site-packages/pydevd.py", line 16, in <module>
[Default]     from _pydevd_bundle.pydevd_collect_try_except_info import collect_return_info
[Default] ModuleNotFoundError: No module named '_pydevd_bundle.pydevd_collect_try_except_info'
[PythonPlugin] Python plugin 'binary_ninja_plugin' could not be loaded

sys.path:

[Default] ['/home/n/.binaryninja/plugins',
[Default]  '/home/n/.binaryninja/python311/site-packages',
[Default]  '/opt/binaryninja/plugins/../python3',
[Default]  '/opt/binaryninja/plugins/../python',
[Default]  '/home/n/git/binary_ninja_plugin/venv/lib/python3.11/site-packages',
[Default]  '/usr/lib/python311.zip',
[Default]  '/usr/lib/python3.11',
[Default]  '/usr/lib/python3.11/lib-dynload',
[Default]  '/opt/binaryninja/python',
[Default]  '/opt/binaryninja/python3',
[Default]  '/usr/local/lib/python3.11/dist-packages',
[Default]  '/usr/lib/python3/dist-packages',
[Default]  '/usr/lib/python3.11/dist-packages']

But now that i'm looking around the internet some more: Many have the same issue in a bunch of different contexts..
For example:

• https://youtrack.jetbrains.com/issue/PY-46911/Recent-version-build-203.7148.72-of-pydevdpycharm-does-not-work
• ModuleNotFoundError: No module named '_pydevd_bundle.pydevd_collect_try_except_info' overfl0/IDAPython-pycharm-setup#1

Can't really seen any good reason for this issue, as the only site package with content is the venv one, and that should only contain pycharms version of pydevd

[N0K0]

Wait a sec, it get more interesting!

pip install --force-reinstall pydevd-pycharm~=233.13135.95

Running this command actually solved the issue. This is then in the context of the venv under binary_ninja_plugin, after i've wiped everything from the user content folder site-packages.

Not sure where we should take this next now :S

[xusheng6]

I feel like there is some bug with PyCharm and it is out of our hand.

I will try to replicate your setup and see if I get the same error.

Btw, do you mean you already have a viable workaround for it? If so, this would be less urgent to be dealt with

[N0K0]

This is not urgent! :)

The setup works, but would not call it a workaround just yet.

Will try to replicate the fault state and fix once more over the weekend to verify! :)

[xusheng6]

I have created an issue for it so I am marking this as answered