Add python-kafka integration test #1782
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces kafka integration tests using the kafka-python-ng driver, following a similar approach as #1690
This includes:
ensure_uv_is_installed
to install uv to shotover's target directoryrun_python_smoke_test
that callsensure_uv_is_installed
and then runs the uv project, passing in required configuration.run_python_smoke_test
uv was chosen as it drastically simplifies python package management and is easy to install.
Compare the current implementation to https://github.com/shotover/shotover-proxy/pull/1267/files where we had to manually wrangle venvs in order to create an isolated and reproducible python environment. uv handles all of that for us and is a lot faster.
Time to run
Future work
This sets us up to write an integration test for the python driver that uses sasl scram which is known to be broken in shotover.
However I've left that out of this initial PR to keep scope down.