Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: [RRIO] [Cache] Write transform #28908

Closed
1 of 3 tasks
damondouglas opened this issue Oct 9, 2023 · 0 comments · Fixed by #29401
Closed
1 of 3 tasks

[Task]: [RRIO] [Cache] Write transform #28908

damondouglas opened this issue Oct 9, 2023 · 0 comments · Fixed by #29401

Comments

@damondouglas
Copy link
Contributor

damondouglas commented Oct 9, 2023

The output of this task is a Cache Write transform that transforms a PCollection of element KVs and writes the pair to an external resource, persisting their association. Re-uses the Call PTransform and therefore serves as a dependency.

Measures of Ready

Measures of Done

  • Write operations are not coupled with the transforms DoFn but rather provided through an interface
  • Tests validate that matching elements persist and are retrievable in the same state association

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

@damondouglas damondouglas self-assigned this Oct 9, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] Implement a Cache Write transform [Task]: [RRIO] [Cache] Implement a Cache Write transform Oct 10, 2023
@damondouglas damondouglas changed the title [Task]: [RRIO] [Cache] Implement a Cache Write transform [Task]: [RRIO] [Cache] Write transform Oct 10, 2023
@github-actions github-actions bot added this to the 2.53.0 Release milestone Nov 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant