-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
e2e: skip long running tests by default. #373
e2e: skip long running tests by default. #373
Conversation
@askervin @fmuyassarov @kad @pfl PTAL. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
The only improvement that I could come up with is printing something like "SKIP $TEST_DIR (long_tests=no)", as I can imagine myself wondering after few months why ./run_tests.sh doesn't do anything.
But this is a comment rather than a request because "Running tests matching:..." already should reveal what is going on. And I can imagine also finding the explanation soon enough from there. :D
Skip time consuming tests by default. Run them if skip_long_tests=no is set. A test is assumed to be time consuming if the test directory matches any of the *long*, *fuzz*, or *stress* patterns. Signed-off-by: Krisztian Litkey <[email protected]>
0b4ab32
to
fc52b55
Compare
Good point. I'm think I myself would not realize after a week why long tests are not run at all. Updated, adding printouts when we skip tests. I also inverted the control variable name and semantics to |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Skip tests matching *long*, *fuzz*, or *stress* by default. Run them when
skip_long_tests=no
is set.