Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

InferenceResponse error code is lost in Python BLS #7804

Open
ShuaiShao93 opened this issue Nov 15, 2024 · 1 comment
Open

InferenceResponse error code is lost in Python BLS #7804

ShuaiShao93 opened this issue Nov 15, 2024 · 1 comment

Comments

@ShuaiShao93
Copy link

Description
When we receive InferenceResponse from another model in Python BLS, the error code in it is lost and always reset to INTERNAL no matter what is actually returned.

Triton Information
What version of Triton are you using?
24.09

Are you using the Triton container or did you build it yourself?
Triton container

To Reproduce

  1. Develop a model A that returns
pb_utils.InferenceResponse(
    error=pb_utils.TritonError(
        "unsupported feature",
        pb_utils.TritonError.UNSUPPORTED,
    )
)
  1. Develop a model B as a BLS that calls into model A, and inspect the response error code
if infer_response.has_error():
    assert False, infer_response.error().code()
  1. Get <__ErrorCode.INTERNAL: 1>

Expected behavior
The error code should be UNSUPPORTED

@caoyuan0816
Copy link

+1 for that issue, we are seeing exactly same issue here, anyone take a look of it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants