Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: [RRIO] [Call] PTransform executes user custom code without adaptive throttling #28711

Closed
7 tasks done
damondouglas opened this issue Sep 27, 2023 · 0 comments
Assignees

Comments

@damondouglas
Copy link
Contributor

damondouglas commented Sep 27, 2023

What needs to happen?

The output of this task is an implementation of the a Call PTransform and related DoFn that executes custom user code as defined in #28710. The DoFn adheres to the following specification:

class CallFn<KeyT, RequestT, ResponseT, ApiErrorT extends ApiException> 
    extends DoFn<KV<KeyT, RequestT>, KV<KeyT, ResponseT>> {}

Measures of Ready

Measures of Done

  • class Call<RequesT, ResponseT> extends PTransform<PCollection<RequestT>, Call.Result>
  • class Result<RequestT, ResponseT> implements POutput
  • class CallFn<RequestT, ResponseT> extends DoFn<RequestT, ResponseT>
  • CallFn executes custom code during setup, teardown and process lifecycle methods
  • Tests validate error messages expected from invalid parameter inputs
  • Integration tests validate calls to deployed endpoint

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

@damondouglas damondouglas self-assigned this Sep 27, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] Implement Call DoFn without throttling [Task]: [RRIO] Implement Call without throttling Oct 10, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] Implement Call without throttling [Task]: [RRIO] Implement Call without adaptive throttling Oct 10, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] Implement Call without adaptive throttling [Task]: [RRIO] [Call] Implement Call PTransform without adaptive throttling Oct 10, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] [Call] Implement Call PTransform without adaptive throttling [Task]: [RRIO] [Call] Implement PTransform that executes user custom code without adaptive throttling Oct 10, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] [Call] Implement PTransform that executes user custom code without adaptive throttling [Task]: [RRIO] [Call] PTransform that executes user custom code without adaptive throttling Oct 10, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] [Call] PTransform that executes user custom code without adaptive throttling [Task]: [RRIO] [Call] PTransform executes user custom code without adaptive throttling Oct 10, 2023
@github-actions github-actions bot added this to the 2.53.0 Release milestone Nov 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant