Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: skip long running tests by default. #373

Merged

Conversation

klihub
Copy link
Collaborator

@klihub klihub commented Oct 3, 2024

Skip tests matching *long*, *fuzz*, or *stress* by default. Run them when skip_long_tests=no is set.

@klihub klihub requested review from askervin and fmuyassarov October 3, 2024 12:36
@klihub klihub changed the title test/e2e: omit long running tests by default. e2e: omit long running tests by default. Oct 4, 2024
@klihub
Copy link
Collaborator Author

klihub commented Oct 4, 2024

@askervin @fmuyassarov @kad @pfl PTAL.

test/e2e/run_tests.sh Outdated Show resolved Hide resolved
Copy link
Collaborator

@askervin askervin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

The only improvement that I could come up with is printing something like "SKIP $TEST_DIR (long_tests=no)", as I can imagine myself wondering after few months why ./run_tests.sh doesn't do anything.

But this is a comment rather than a request because "Running tests matching:..." already should reveal what is going on. And I can imagine also finding the explanation soon enough from there. :D

Skip time consuming tests by default. Run them if skip_long_tests=no
is set. A test is assumed to be time consuming if the test directory
matches any of the *long*, *fuzz*, or *stress* patterns.

Signed-off-by: Krisztian Litkey <[email protected]>
@klihub klihub force-pushed the devel/skip-loooong-tests-by-default branch from 0b4ab32 to fc52b55 Compare October 7, 2024 07:19
@klihub
Copy link
Collaborator Author

klihub commented Oct 7, 2024

LGTM.

The only improvement that I could come up with is printing something like "SKIP $TEST_DIR (long_tests=no)", as I can imagine myself wondering after few months why ./run_tests.sh doesn't do anything.

Good point. I'm think I myself would not realize after a week why long tests are not run at all. Updated, adding printouts when we skip tests. I also inverted the control variable name and semantics to skip_long_tests, which feels more correct.

@klihub klihub changed the title e2e: omit long running tests by default. e2e: skip long running tests by default. Oct 7, 2024
@klihub klihub requested review from pfl and askervin October 7, 2024 07:25
Copy link
Collaborator

@askervin askervin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@fmuyassarov fmuyassarov merged commit 09d705a into containers:main Oct 7, 2024
3 checks passed
@klihub klihub deleted the devel/skip-loooong-tests-by-default branch October 7, 2024 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants