Duet AI documentation lookup prompts for Beam ML #30351

olehborysevych · 2024-02-20T09:27:38Z

First part of beam ml lookup prompts

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
Update CHANGES.md with noteworthy changes.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

learning/prompts/documentation-lookup/33_ai_ml_pipelines.md

learning/prompts/documentation-lookup/36_ai_kfp_orchestration.md

Co-authored-by: Daria Bezkorovaina <[email protected]>

…hub.com/akvelon/beam into duet-ai-ml-documentation-lookup-prompts

dariabezkorovaina · 2024-02-23T10:29:58Z

learning/prompts/documentation-lookup/33_ai_ml_pipelines.md

+How can I use Apache Beam in my AI/ML pipeline?
+
+Response:
+You can use Apache Beam for data ingestion, validation, preprocessing, and inference.


Suggested change

You can use Apache Beam for data ingestion, validation, preprocessing, and inference.

You can use Apache Beam for various tasks within your AI/ML pipeline, including data validation, preprocessing, model validation, and model deployment and inference.

learning/prompts/documentation-lookup/36_ai_kfp_orchestration.md

learning/prompts/documentation-lookup/37_ai_tfx_orchestration.md

learning/prompts/documentation-lookup/43_ai_llm_inference.md

Co-authored-by: Daria Bezkorovaina <[email protected]>

olehborysevych · 2024-03-05T13:59:32Z

@dariabezkorovaina all your comments are resolved

github-actions · 2024-03-05T14:05:58Z

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @jrmccluskey added as fallback since no labels match configuration

Available commands:

stop reviewer notifications - opt out of the automated review tooling
remind me after tests pass - tag the comment author after tests pass
waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

dariabezkorovaina

Nits mostly related to line spacing and formatting of the section names after removing links from them:

Used single quotation marks ' ' for section names
Used for transforms, classes, methods (i.e. parts of a code)
Removed from the words that are not parts of a code, such as PyTorch (name of the library)

learning/prompts/documentation-lookup/37_ai_tfx_orchestration.md

learning/prompts/documentation-lookup-nolinks/33_ai_ml_pipelines.md

learning/prompts/documentation-lookup/33_ai_ml_pipelines.md

learning/prompts/documentation-lookup-nolinks/33_ai_ml_pipelines.md

learning/prompts/documentation-lookup/43_ai_llm_inference.md

learning/prompts/documentation-lookup/38_ai_runinference.md

learning/prompts/documentation-lookup-nolinks/33_ai_ml_pipelines.md

learning/prompts/documentation-lookup-nolinks/38_ai_runinference.md

Co-authored-by: Daria Bezkorovaina <[email protected]>

dariabezkorovaina

LGTM

olehborysevych · 2024-03-07T12:57:09Z

Hey @damccorm, this one is also ready for review.

damccorm

Overall looks good, had a few comments - the LLM piece is the only really significant one. Please make edits in both the no link and with links sections!

Thanks!

learning/prompts/documentation-lookup-nolinks/33_ai_ml_pipelines.md

learning/prompts/documentation-lookup-nolinks/38_ai_runinference.md

learning/prompts/documentation-lookup-nolinks/40_ai_bigquery_ml.md

learning/prompts/documentation-lookup-nolinks/42_ai_custom_inference.md

learning/prompts/documentation-lookup-nolinks/43_ai_llm_inference.md

learning/prompts/documentation-lookup/33_ai_ml_pipelines.md

olehborysevych · 2024-03-11T07:45:10Z

Overall looks good, had a few comments - the LLM piece is the only really significant one. Please make edits in both the no link and with links sections!

Thanks!

Thank you @damccorm Done!.

damccorm

Looks good, just had one more minor nit

learning/prompts/documentation-lookup-nolinks/42_ai_custom_inference.md

learning/prompts/documentation-lookup/42_ai_custom_inference.md

Co-authored-by: Danny McCormick <[email protected]>

olehborysevych · 2024-03-12T11:27:11Z

Thank you @damccorm!

damccorm

Thanks!

* ml prompts initial commit * preprocess data added * orchedstration prompts added * orchestration prompts * new files added * ml prompts added * bigqueryml prompt added * fix whitespace * add model refresh prompt * custom inference added * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * llm inference added * whitespace fixed * code review comments * nolinks docs added * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * fixed broken link * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * Apply suggestions from code review Co-authored-by: Daria Bezkorovaina <[email protected]> * code review comments * whitespace fix * Apply suggestions from code review Co-authored-by: Danny McCormick <[email protected]> --------- Co-authored-by: Daria Bezkorovaina <[email protected]> Co-authored-by: Danny McCormick <[email protected]>

Oleh Borysevych added 8 commits February 7, 2024 00:46

ml prompts initial commit

9491b74

preprocess data added

10475fb

orchedstration prompts added

6ab51e0

orchestration prompts

3156103

new files added

9d32d2a

ml prompts added

d31505a

bigqueryml prompt added

31c90e4

fix whitespace

104af50

github-actions bot added the learning label Feb 20, 2024

add model refresh prompt

2a7e626

dariabezkorovaina suggested changes Feb 21, 2024

View reviewed changes

Oleh Borysevych and others added 6 commits February 22, 2024 07:52

custom inference added

4d352a4

Apply suggestions from code review

e7d1c10

Co-authored-by: Daria Bezkorovaina <[email protected]>

Merge branch 'duet-ai-ml-documentation-lookup-prompts' of https://git…

8dda35d

…hub.com/akvelon/beam into duet-ai-ml-documentation-lookup-prompts

llm inference added

d90742a

whitespace fixed

e0c7e2d

code review comments

a851199

dariabezkorovaina suggested changes Feb 26, 2024

View reviewed changes

Oleh Borysevych and others added 6 commits March 3, 2024 06:17

nolinks docs added

ea99a49

Apply suggestions from code review

7b04897

Co-authored-by: Daria Bezkorovaina <[email protected]>

Apply suggestions from code review

c815cf6

Co-authored-by: Daria Bezkorovaina <[email protected]>

Apply suggestions from code review

30e50c2

Co-authored-by: Daria Bezkorovaina <[email protected]>

Apply suggestions from code review

73f925d

Co-authored-by: Daria Bezkorovaina <[email protected]>

fixed broken link

74b8d2d

olehborysevych requested a review from dariabezkorovaina March 5, 2024 13:58

olehborysevych changed the title ~~[DRAFT] Duet AI documentation lookup prompts for Beam ML~~ Duet AI documentation lookup prompts for Beam ML Mar 5, 2024

olehborysevych marked this pull request as ready for review March 5, 2024 13:59

github-actions bot added the Next Action: Reviewers label Mar 5, 2024

dariabezkorovaina suggested changes Mar 5, 2024

View reviewed changes

Oleh Borysevych and others added 2 commits March 7, 2024 00:37

Apply suggestions from code review

61f392f

Co-authored-by: Daria Bezkorovaina <[email protected]>

Apply suggestions from code review

883ca5d

Co-authored-by: Daria Bezkorovaina <[email protected]>

dariabezkorovaina approved these changes Mar 7, 2024

View reviewed changes

olehborysevych requested a review from damccorm March 7, 2024 12:56

damccorm reviewed Mar 8, 2024

View reviewed changes

Oleh Borysevych added 2 commits March 10, 2024 11:34

code review comments

4f85a5a

whitespace fix

1337f47

olehborysevych requested a review from damccorm March 11, 2024 08:28

damccorm reviewed Mar 11, 2024

View reviewed changes

learning/prompts/documentation-lookup-nolinks/42_ai_custom_inference.md Outdated Show resolved Hide resolved

learning/prompts/documentation-lookup/42_ai_custom_inference.md Outdated Show resolved Hide resolved

Apply suggestions from code review

95bd796

Co-authored-by: Danny McCormick <[email protected]>

olehborysevych requested a review from damccorm March 12, 2024 11:26

damccorm approved these changes Mar 12, 2024

View reviewed changes

damccorm merged commit 35252b9 into apache:master Mar 12, 2024
4 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Duet AI documentation lookup prompts for Beam ML #30351

Duet AI documentation lookup prompts for Beam ML #30351

olehborysevych commented Feb 20, 2024

dariabezkorovaina Feb 23, 2024

olehborysevych commented Mar 5, 2024

github-actions bot commented Mar 5, 2024

dariabezkorovaina left a comment

dariabezkorovaina left a comment

olehborysevych commented Mar 7, 2024

damccorm left a comment

olehborysevych commented Mar 11, 2024

damccorm left a comment

olehborysevych commented Mar 12, 2024

damccorm left a comment

	You can use Apache Beam for data ingestion, validation, preprocessing, and inference.
	You can use Apache Beam for various tasks within your AI/ML pipeline, including data validation, preprocessing, model validation, and model deployment and inference.

Duet AI documentation lookup prompts for Beam ML #30351

Duet AI documentation lookup prompts for Beam ML #30351

Conversation

olehborysevych commented Feb 20, 2024

GitHub Actions Tests Status (on master branch)

dariabezkorovaina Feb 23, 2024

Choose a reason for hiding this comment

olehborysevych commented Mar 5, 2024

github-actions bot commented Mar 5, 2024

dariabezkorovaina left a comment

Choose a reason for hiding this comment

dariabezkorovaina left a comment

Choose a reason for hiding this comment

olehborysevych commented Mar 7, 2024

damccorm left a comment

Choose a reason for hiding this comment

olehborysevych commented Mar 11, 2024

damccorm left a comment

Choose a reason for hiding this comment

olehborysevych commented Mar 12, 2024

damccorm left a comment

Choose a reason for hiding this comment