Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport/2.x] Backport commits from feature branch #300

Merged
merged 27 commits into from
Dec 18, 2023

Conversation

dbwiddis
Copy link
Member

We want to preserve the original PR commit history

Do NOT "Squash and Merge".  Choose the "Rebase and Merge" option.

Description

Backports the following commits on main from #297
088ee99
606ad94
ffc0aa4
b7f638b
ac6d085
860bc54
e99f83c
aae49ab
cf02b96
8ee032b
e0947ee
b04e1c5
1c6750a
d067f9c
8d6b532
7eadd3d
02d0445
6447ac6
1d2c861
8528af9
8d9128c
7a82c58
a62bdf0
ea3ee52
1b64d5a
887a176
0f23dff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

owaiskazi19 and others added 27 commits December 18, 2023 14:13
opensearch-project#198)

* Initial register agent workflow step

Signed-off-by: Owais Kazi <[email protected]>

* Added tools step

Signed-off-by: Owais Kazi <[email protected]>

* Fixed ClassCastException

Signed-off-by: Owais Kazi <[email protected]>

* Handled exception for Instant

Signed-off-by: Owais Kazi <[email protected]>

* Added type Instant for WorklowNode Parser

Signed-off-by: Owais Kazi <[email protected]>

* Removed created and last updated time

Signed-off-by: Owais Kazi <[email protected]>

* Addressed parsing error

Signed-off-by: Owais Kazi <[email protected]>

* Handled parsing of Long values for Instant

Signed-off-by: Owais Kazi <[email protected]>

* Handled nested object for llm key

Signed-off-by: Owais Kazi <[email protected]>

* Handled parsing error

Signed-off-by: Owais Kazi <[email protected]>

* Another attempt to fix parsing error for llm

Signed-off-by: Owais Kazi <[email protected]>

* Another attemp to fix XContent

Signed-off-by: Owais Kazi <[email protected]>

* Fixed Parsing error

Signed-off-by: Owais Kazi <[email protected]>

* Added tests for toolstep and javadocs

Signed-off-by: Owais Kazi <[email protected]>

* Undo CI changes

Signed-off-by: Owais Kazi <[email protected]>

* Addressing PR comments

Signed-off-by: Owais Kazi <[email protected]>

* Addressing PR comments

Signed-off-by: Owais Kazi <[email protected]>

* Handled interface changes

Signed-off-by: Owais Kazi <[email protected]>

* Addressed conflicts

Signed-off-by: Owais Kazi <[email protected]>

* Added TODO

Signed-off-by: Owais Kazi <[email protected]>

---------

Signed-off-by: Owais Kazi <[email protected]>
…ct#211)

* Add Delete Connector Step

Signed-off-by: Daniel Widdis <[email protected]>

* Add eclipse core runtime version resolution

Signed-off-by: Daniel Widdis <[email protected]>

* Use JDK17 for spotless

Signed-off-by: Daniel Widdis <[email protected]>

* Add Delete Connector Step

Signed-off-by: Daniel Widdis <[email protected]>

* Add eclipse core runtime version resolution

Signed-off-by: Daniel Widdis <[email protected]>

* Use JDK17 for spotless

Signed-off-by: Daniel Widdis <[email protected]>

* Fetch connector ID from appropriate previous node output

Signed-off-by: Daniel Widdis <[email protected]>

* Fix tests

Signed-off-by: Daniel Widdis <[email protected]>

* Test that actual ID is properly passed

Signed-off-by: Daniel Widdis <[email protected]>

* Update to current setup-java version

Signed-off-by: Daniel Widdis <[email protected]>

* Remove unneeded argument captors

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
…ch-project#231)

* adding new resources created format and adding enum for resource types

Signed-off-by: Amit Galitzky <[email protected]>

* remove spotless from java 17

Signed-off-by: Amit Galitzky <[email protected]>

* add action listener to update resource created

Signed-off-by: Amit Galitzky <[email protected]>

* fixing UT

Signed-off-by: Amit Galitzky <[email protected]>

* changed exception type

Signed-off-by: Amit Galitzky <[email protected]>

---------

Signed-off-by: Amit Galitzky <[email protected]>
… workflow steps (opensearch-project#235)

* Flattened llm field of register agent

Signed-off-by: Owais Kazi <[email protected]>

* Handled optional modelId

Signed-off-by: Owais Kazi <[email protected]>

* Handled modelId for llm

Signed-off-by: Owais Kazi <[email protected]>

* Parsing for parameters field of tools

Signed-off-by: Owais Kazi <[email protected]>

* Handled test case failures

Signed-off-by: Owais Kazi <[email protected]>

* Fixed spotless failure

Signed-off-by: Owais Kazi <[email protected]>

---------

Signed-off-by: Owais Kazi <[email protected]>
…s step output (opensearch-project#234)

* Util method to get required inputs

Signed-off-by: Daniel Widdis <[email protected]>

* Implement parsing in some of the steps

Signed-off-by: Daniel Widdis <[email protected]>

* Handle parsing exceptions in the future

Signed-off-by: Daniel Widdis <[email protected]>

* Improve exception handling

Signed-off-by: Daniel Widdis <[email protected]>

* More steps using the new input parsing

Signed-off-by: Daniel Widdis <[email protected]>

* Update Delete Connector Step with parsing util

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
…tory (opensearch-project#243)

Actually make the WorkflowStepFactory a Factory

Signed-off-by: Daniel Widdis <[email protected]>
…lSteps (opensearch-project#242)

* Add agentId to parameters map for root agent

Signed-off-by: Owais Kazi <[email protected]>

* Modified ToolStep with new Util method

Signed-off-by: Owais Kazi <[email protected]>

* Integrated RegisterAgentStep with new Util method

Signed-off-by: Owais Kazi <[email protected]>

* Spotless fixes

Signed-off-by: Owais Kazi <[email protected]>

* Removed TODO

Signed-off-by: Owais Kazi <[email protected]>

---------

Signed-off-by: Owais Kazi <[email protected]>
Adding state index update on agent

Signed-off-by: Amit Galitzky <[email protected]>
…pensearch-project#245)

* Added retry functionality for DeployModel

Signed-off-by: Owais Kazi <[email protected]>

* Fixed timeout and exception issues

Signed-off-by: Owais Kazi <[email protected]>

* Addressed PR Comments

Signed-off-by: Owais Kazi <[email protected]>

---------

Signed-off-by: Owais Kazi <[email protected]>
* fixing status api bug with new deploy task

Signed-off-by: Amit Galitzky <[email protected]>

* changed to getName()

Signed-off-by: Amit Galitzky <[email protected]>

---------

Signed-off-by: Amit Galitzky <[email protected]>
…search-project#262)

Includ workflow id and current node id in the exception message during registe agent step

Signed-off-by: Jackie Han <[email protected]>
…oject#265)

change thread queue to 100 and fix headers bug

Signed-off-by: Amit Galitzky <[email protected]>
…ch-project#231)

* adding new resources created format and adding enum for resource types

Signed-off-by: Amit Galitzky <[email protected]>

* remove spotless from java 17

Signed-off-by: Amit Galitzky <[email protected]>

* add action listener to update resource created

Signed-off-by: Amit Galitzky <[email protected]>

* fixing UT

Signed-off-by: Amit Galitzky <[email protected]>

* changed exception type

Signed-off-by: Amit Galitzky <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
template by workflow id (opensearch-project#273)

* renaming status API implementation

Signed-off-by: Joshua Palis <[email protected]>

* Adding GetWorkflow API

Signed-off-by: Joshua Palis <[email protected]>

* addressing PR comments

Signed-off-by: Joshua Palis <[email protected]>

* Adding todo reminder

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>
…h-project#284)

* Modifying workflow state index mapping and resources created

Signed-off-by: Joshua Palis <[email protected]>

* Adding Search workflow state API

Signed-off-by: Joshua Palis <[email protected]>

* Adding rest unit tests

Signed-off-by: Joshua Palis <[email protected]>

* Transport unit tests

Signed-off-by: Joshua Palis <[email protected]>

* Moving resourceType determination outside of the resources created class

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>
…ensearch-project#282)

* replace dryrun parameter with provision in create workflow

Signed-off-by: Jackie Han <[email protected]>

* test

Signed-off-by: Jackie Han <[email protected]>

* test

Signed-off-by: Jackie Han <[email protected]>

* test

Signed-off-by: Jackie Han <[email protected]>

* Combine create api with provision api by adding a provision param

Signed-off-by: Jackie Han <[email protected]>

* cleanup

Signed-off-by: Jackie Han <[email protected]>

* keep dryrun option in create workflow

Signed-off-by: Jackie Han <[email protected]>

* cleanup

Signed-off-by: Jackie Han <[email protected]>

* keep both dryRun and provision parameter

Signed-off-by: Jackie Han <[email protected]>

---------

Signed-off-by: Jackie Han <[email protected]>
* Deprovision REST and Transport Actions

Signed-off-by: Daniel Widdis <[email protected]>

* Fix errors you find actually running the code

Signed-off-by: Daniel Widdis <[email protected]>

* Add test for Rest deprovision action

Signed-off-by: Daniel Widdis <[email protected]>

* Initial copypaste of Deprovision Transport Action Test

Signed-off-by: Daniel Widdis <[email protected]>

* Add some delays to let deletions propagate, reset workflow state

Signed-off-by: Daniel Widdis <[email protected]>

* Improved deprovisioning results and status updates

Signed-off-by: Daniel Widdis <[email protected]>

* Fix bug in resource created parsing

Signed-off-by: Daniel Widdis <[email protected]>

* Completed test implementations

Signed-off-by: Daniel Widdis <[email protected]>

* Fixes after rebase

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
…arch-project#290)

* Adding installed plugins validation

Signed-off-by: Joshua Palis <[email protected]>

* Adding failure success unit tests

Signed-off-by: Joshua Palis <[email protected]>

* Combining graph and installed plugin validation

Signed-off-by: Joshua Palis <[email protected]>

* Removing stray comment

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>
…h-project#295)

* Always consume the workflow_id param

Signed-off-by: Daniel Widdis <[email protected]>

* Delegate no-content error message to BaseRestHandler

Signed-off-by: Daniel Widdis <[email protected]>

* Don't lose FlowFrameworkException status

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
@dbwiddis dbwiddis merged commit b7f5317 into opensearch-project:2.x Dec 18, 2023
13 checks passed
@dbwiddis dbwiddis deleted the backport/feature-branch branch December 18, 2023 22:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants