Enhancement - Improve SDK output format

[aybruhm]

Description

This PR updates the SDK output format to expect a JSON response with a specific structure, ensuring backward compatibility for existing output formats, and introducing an additional latency field in the JSON response.

Related Issue

Closes first task in #988

[aybruhm]

@mmabrouk, the reason for the high number of commits is due to merging the main branch into the feature branch for synchronization. If we change the base branch from feature/add-metrics-to-sdk-playground-evaluation to main, the additional commits will be eliminated. As this PR is not yet ready for merging into the main branch, a feature branch was created instead.

Please let me know if any part of my explanation is unclear. Thank you.

[aybruhm]

@mmabrouk, the reason for the high number of commits is due to merging the main branch into the feature branch for synchronization. If we change the base branch from feature/add-metrics-to-sdk-playground-evaluation to main, the additional commits will be eliminated. As this PR is not yet ready for merging into the main branch, a feature branch was created instead.

Please let me know if any part of my explanation is unclear. Thank you.

The files that you should review are:

• agenta_decorator
• sdk types
• llm example app

[mmabrouk]

Hey @aybruhm , thanks a lot for the PR!
However, it's extremely hard to review due to it being a merge together with the PR
Maybe merge main to add-metrics-to-sdk-playground-eval too so that the diff shows only the changes you made?

[aybruhm]

Hey @aybruhm , thanks a lot for the PR! However, it's extremely hard to review due to it being a merge together with the PR Maybe merge main to add-metrics-to-sdk-playground-eval too so that the diff shows only the changes you made?

I've done that, thank you.

[mmabrouk]

Great job @aybruhm and sorry for the late answer. Please see the minor comments.