Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Main to evaluations in backend #1187

Merged
merged 169 commits into from
Jan 11, 2024
Merged

Main to evaluations in backend #1187

merged 169 commits into from
Jan 11, 2024

Conversation

aakrem
Copy link
Collaborator

@aakrem aakrem commented Jan 11, 2024

No description provided.

aybruhm and others added 30 commits December 10, 2023 14:24
@aybruhm
Feat - introduce func response type
8be6ab6
@aybruhm
Update - improve execute_function and entrypoint functions
e9356b3
@aybruhm
Merge branch 'main' into gh/sdk-output-format-change
fe7180b
@aybruhm
Update - modified execute_function to make use of time.perf_counter a…
993a455 
…nd also cleanup imports and entrypoint function
@aybruhm
🎨 Format - ran black
ecad1c2
@aybruhm
Update - refactor types for func execute in sdk
c686dfe
@aybruhm
Update - modified execute_function return response
c9a0cbc
@aybruhm
Feat - created example app that uses the new sdk output format
33c43e6
@mmabrouk
Minor refactor
df2dd20
@aybruhm
Feat - created openai_cost helper function
60f483f
@aybruhm
Update - change cost type to float from str
99a95e9
@aybruhm
Feat - implemented calculate_token_usage helper function
2a1f381
@aybruhm
Update - change cost type to float from str
590ad2d
@aybruhm
Update - import calculate_token_usage helper function in sdk/__init__…
f22104b 
….py module
@aybruhm
Update - added cost to example app
40734db
@aybruhm
🎨 Format - ran black
0e32ea5
@aybruhm
🎨 Format - ran black
72366c1
@aakrem
add costs source
6b10ce3
@aakrem
Merge pull request #1025 from Agenta-AI/gh/sdk-output-format-change
a0a2005 
Enhancement - Improve SDK output format
@bekossy
feat: add cost, latency and usage to playground
b5d4cdb
@aybruhm
Refactor - update templates return response
84dbeaf
@devgenix @aybruhm
create cli client backend from openapi.json using fern
fb904ef
@devgenix @aybruhm
rewrite cli to use new client
4d9070b
@devgenix @aybruhm
format black
c752a00
@devgenix @aybruhm
rename folder and move to api
745f6d7
@devgenix @aybruhm
rename client to api.py
1133341
@devgenix @aybruhm
create exceptions
62aad1e
@devgenix @aybruhm
update imports path
e8d1782
@devgenix @aybruhm
initialie client properly
4594d38
@devgenix @aybruhm
fix validate api key
ff55bb9
devgenix and others added 29 commits December 26, 2023 08:25
@devgenix @aybruhm
add step to set timeout
1aeec53
@devgenix @aybruhm
Update Readme.md with image description
78ba872
@mmabrouk
Merge pull request #1096 from Agenta-AI/Sub-issue-1059/-Add-cost,-lat…
01ba0d1 
…ency,-tokens-to-playground

Add cost, latency, tokens to playground
@mmabrouk
Merge branch 'main' into feature/add-metrics-to-sdk-playground-evalua…
b3eed50 
…tion
@mmabrouk
Merge pull request #1111 from Agenta-AI/gh/update_templates_cost_latency
f29983d 
Enhancement - improve LLM app templates response
@mmabrouk
Update main.py
a294424
@mmabrouk
Fix result type conversion in evaluation tables
abf1ec1
@bekossy
remove cost, latency and usage if res is a string
fdf797c
@bekossy
null checks added
e8caf7e
@mmabrouk
Merge pull request #1155 from Agenta-AI/bugfix/evaluation_new_sdk
e9b5fad 
Make new SDK work with evaluation
@devgenix
fix broken links
10f7579
@mmabrouk
register_default now per default does not overwrite
481d431
@mmabrouk
allow overwrite when parameters are empty even if overwrite is set to…
a5d3549 
… False
@mmabrouk
Update variant image now removes configuration
af5b33f
@mmabrouk
formatting
a9c2d35
@mmabrouk
Fix
396eee4
@mmabrouk
Update link to LLM app tutorial
5b7ad6e
@mmabrouk
Update tutorial and template links
16d8c1b
@mmabrouk
Update links in deprecated documentation
b23c990
@mmabrouk
Update links in documentation
4549925
@mmabrouk
Update links in README.md
72f47e8
@mmabrouk
Merge pull request #1151 from Agenta-AI/feature/add-metrics-to-sdk-pl…
0636c5a 
…ayground-evaluation

Add metrics to SDK
@mmabrouk
Merge pull request #1166 from Agenta-AI/1147-bug-fix-deadlinks-in-the…
693fbdc 
…-documentation

fix broken links
@mmabrouk
Merge pull request #1169 from Agenta-AI/bugfix/saving_parameters
3aa948a 
Fix register_default overwrite behavior
@mmabrouk
Update pyproject.toml
0e3957e
@mmabrouk
Merge pull request #1180 from Agenta-AI/mmabrouk-patch-4
65081e2 
Update pyproject.toml
@mmabrouk
hotfix
086bb76
@mmabrouk
Merge pull request #1183 from Agenta-AI/hotfix/pydantic_downgrade
044130a 
hotfix pydantic downgrade
@aakrem
Merge branch 'main' into main-to-evaluations-in-backend
89c355e
@aakrem aakrem merged commit 1b3f505 into evaluations-in-backend Jan 11, 2024
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@aakrem @aybruhm @mmabrouk @bekossy @devgenix @MohammedMaaz @romainrbr