Refactor to use structlog

[matmair]

Directly calling the logging module does bypass structlog, this fixes that

[netlify]

✅ Deploy Preview for inventree-web-pui-preview canceled.

Name	Link
🔨 Latest commit	5c5f302
🔍 Latest deploy log	https://app.netlify.com/sites/inventree-web-pui-preview/deploys/6776b66548b58f00072cb8fd

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 84.65%. Comparing base (5eeb150) to head (5c5f302).
Report is 2 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #8747      +/-   ##
==========================================
- Coverage   85.10%   84.65%   -0.46%     
==========================================
  Files        1178     1180       +2     
  Lines       51748    51925     +177     
  Branches     2091     2013      -78     
==========================================
- Hits        44040    43956      -84     
- Misses       7178     7472     +294     
+ Partials      530      497      -33     

Flag	Coverage Δ
backend	86.90% <100.00%> (-0.01%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[SchrodingersGat]

@matmair nice, this will be a great improvement to the logging

[SchrodingersGat]

@matmair this merge has broken some processes. The docker image CI step no longer succeeds for example:

https://github.com/inventree/InvenTree/actions/runs/12615522315/job/35155688674

And I have just pulled down master and attemted to run invoke update which resulted in:

Traceback (most recent call last):
  File "/usr/bin/invoke", line 8, in <module>
    sys.exit(program.run())
             ^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/invoke/program.py", line 398, in run
    self.execute()
  File "/usr/lib/python3.11/site-packages/invoke/program.py", line 583, in execute
    executor.execute(*self.tasks)
  File "/usr/lib/python3.11/site-packages/invoke/executor.py", line 140, in execute
    result = call.task(*args, **call.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/invoke/tasks.py", line 138, in __call__
    result = self.body(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/inventree/tasks.py", line 582, in update
    install(c, uv=uv)
  File "/usr/lib/python3.11/site-packages/invoke/tasks.py", line 138, in __call__
    result = self.body(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/inventree/tasks.py", line 316, in install
    plugins(c, uv=uv)
  File "/usr/lib/python3.11/site-packages/invoke/tasks.py", line 138, in __call__
    result = self.body(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/inventree/tasks.py", line 264, in plugins
    from src.backend.InvenTree.InvenTree.config import get_plugin_file
  File "/home/inventree/src/backend/InvenTree/InvenTree/config.py", line 15, in <module>
    import structlog
ModuleNotFoundError: No module named 'structlog'

[SchrodingersGat]

Ah, ok this is the annoying pathing issue when calling invoke from the docker image.

The installed "invoke" tool is not in the proper venv:

> which invoke
/usr/bin/invoke

So calling invoke version gives:

Traceback (most recent call last):
  File "/usr/bin/invoke", line 8, in <module>
    sys.exit(program.run())
             ^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/invoke/program.py", line 398, in run
    self.execute()
  File "/usr/lib/python3.11/site-packages/invoke/program.py", line 583, in execute
    executor.execute(*self.tasks)
  File "/usr/lib/python3.11/site-packages/invoke/executor.py", line 140, in execute
    result = call.task(*args, **call.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/invoke/tasks.py", line 138, in __call__
    result = self.body(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/inventree/tasks.py", line 1146, in version
    import src.backend.InvenTree.InvenTree.version as InvenTreeVersion
  File "/home/inventree/src/backend/InvenTree/InvenTree/version.py", line 23, in <module>
    import structlog
ModuleNotFoundError: No module named 'structlog'

Whereas calling python -m invoke version gives:

InvenTree - inventree.org
The Open-Source Inventory Management System


Python paths:
Executable  /home/inventree/dev/venv/bin/python
Environment /home/inventree/dev/venv

Installation paths:
Base        /home/inventree
Config      /home/inventree/dev/config.yaml
Media       /home/inventree/dev/media
Static      /home/inventree/dev/static

Versions:
Python      3.11.8
Django      4.2.17
InvenTree   0.18.0 dev
API         297
Node        v18.20.1
Yarn        1.22.19

Commit hash: ea9e3fb
Commit date: 2025-01-05

[SchrodingersGat]

With a bit of import hacking I get:

invoke version - called from /usr/bin/invoke

Warning: Dulwich module not found, git information will not be available.

InvenTree - inventree.org
The Open-Source Inventory Management System


Python paths:
Executable  /usr/bin/python3
Environment /usr

Installation paths:
Base        /home/inventree
Config      /home/inventree/dev/config.yaml
Media       /home/inventree/dev/media
Static      /home/inventree/dev/static

Versions:
Python      3.11.8
Django      4.2.16
InvenTree   0.18.0 dev
API         297
Node        v18.20.1
Yarn        1.22.19

Commit hash: None
Commit date: None

python -m invoke version - called from InvenTree venv

InvenTree - inventree.org
The Open-Source Inventory Management System


Python paths:
Executable  /home/inventree/dev/venv/bin/python
Environment /home/inventree/dev/venv

Installation paths:
Base        /home/inventree
Config      /home/inventree/dev/config.yaml
Media       /home/inventree/dev/media
Static      /home/inventree/dev/static

Versions:
Python      3.11.8
Django      4.2.17
InvenTree   0.18.0 dev
API         297
Node        v18.20.1
Yarn        1.22.19

Commit hash: ea9e3fb
Commit date: 2025-01-05

[SchrodingersGat]

I have run into this issue previously but have not been able to quantify it so clearly as this. I think this needs looking into!

[SchrodingersGat]

@matmair I have started a new issue to track this - we need to give it some serious attention!

#8827

[matmair]

Interesting, I do not get this problem in my environment or on CI tests