Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Fix L0_request_cancellation and L0_backend_output_detail byte size checks #363

Merged
merged 3 commits into from
Jun 1, 2024

Conversation

rmccorm4
Copy link
Contributor

@rmccorm4 rmccorm4 commented May 31, 2024

What does the PR do?

Recent byte size validation changes caught issues with the input metadata being provided by these tests.

This PR fixes this:

  1. Fixed input0_data vector to match the expected input shape L0_request_cancellation
  2. Fixed byte size passed by both tests to AppendInputData

Checklist

  • PR title reflects the change and is of format <commit_type>: <Title>
  • Changes are described in the pull request.
  • Related issues are referenced.
  • Populated github labels field
  • Added test plan and verified test passes.
  • Verified that the PR passes existing CI.
  • Verified copyright is correct on all changed files.
  • Added succinct git squash message before merging ref.
  • All template sections are filled out.
  • Optional: Additional screenshots for behavior/output changes with before/after.

Commit Type:

Check the conventional commit type
box here and add the label to the github PR.

  • build
  • ci
  • docs
  • feat
  • fix
  • perf
  • refactor
  • revert
  • style
  • test

Related PRs:

None

Where should the reviewer start?

N/A

Test plan:

Pre-existing tests

Caveats:

None

Background

None

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

None

@rmccorm4 rmccorm4 changed the title Fix L0_request_cancellation and L0_backend_output_detail byte size checks test: Fix L0_request_cancellation and L0_backend_output_detail byte size checks May 31, 2024
@rmccorm4 rmccorm4 changed the title test: Fix L0_request_cancellation and L0_backend_output_detail byte size checks fix: Fix L0_request_cancellation and L0_backend_output_detail byte size checks May 31, 2024
@rmccorm4 rmccorm4 requested a review from kthui May 31, 2024 23:10
jbkyang-nvi
jbkyang-nvi previously approved these changes May 31, 2024
Copy link
Contributor

@jbkyang-nvi jbkyang-nvi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for the change and adhering to the template 🙏

@@ -175,7 +177,7 @@ class RequestCancellationTest : public ::testing::Test {
};

TRITONSERVER_Server* RequestCancellationTest::server_ = nullptr;
std::vector<int32_t> RequestCancellationTest::input0_data_(16, 1);
std::vector<int32_t> RequestCancellationTest::input0_data_(1000, 1);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Q: What's the point of changing it here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It has to match the std::vector<int64_t> input0_shape({1, 1000}); , which is also the shape specified in the config.pbtxt of the model being used for testing

kthui
kthui previously approved these changes Jun 1, 2024
Copy link
Contributor

@kthui kthui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing request cancellation!

@rmccorm4 rmccorm4 dismissed stale reviews from kthui and jbkyang-nvi via 9585bf7 June 1, 2024 00:45
@rmccorm4 rmccorm4 merged commit c26629f into main Jun 1, 2024
1 check passed
@rmccorm4 rmccorm4 deleted the rmccormick-fix-req-cancel branch June 1, 2024 23:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants