Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT]: Having a unified UI for benchmark and demo #28

Open
XuhuiZhou opened this issue Apr 9, 2024 · 8 comments
Open

[FEAT]: Having a unified UI for benchmark and demo #28

XuhuiZhou opened this issue Apr 9, 2024 · 8 comments
Labels
enhancement New feature or request

Comments

@XuhuiZhou
Copy link
Member

XuhuiZhou commented Apr 9, 2024

Description

It would be good to have a unified place for us to place the demo and benchmark:
image
Something like this!

Here's there github repo: https://github.com/allenai/WildBench/tree/main

@Algoroxyolo, feel free to initiate the leaderboard UI

Additional Information

No response

@XuhuiZhou XuhuiZhou added the enhancement New feature or request label Apr 9, 2024
@Algoroxyolo
Copy link
Contributor

Algoroxyolo commented Apr 9, 2024

We have one page right now- so I think it is better to do this when we have multiple pages in the future. As of leaderboard- I am on it now

@lwaekfjlk
Copy link
Member

Hi @XuhuiZhou thanks pointing this out. I think it definitely looks good. If we are planning to add one leaderboard for multiple pages. I believe the repo might be renamed as something like sotopia-webui instead of the current demo. cc @Jasonqi146

@Algoroxyolo
Copy link
Contributor

I am trying to write a leaderboard right now... But for some reason I can not omit the two buttons at the bottom:
image

@XuhuiZhou
Copy link
Member Author

Hi @XuhuiZhou thanks pointing this out. I think it definitely looks good. If we are planning to add one leaderboard for multiple pages. I believe the repo might be renamed as something like sotopia-webui instead of the current demo. cc @Jasonqi146

Right, that's a good point! Something like sotopia-space? We might have other tabs as well in the gradio application

@XuhuiZhou
Copy link
Member Author

@Algoroxyolo did you get a chance to upload the code to the github repo? We can all take a look at it if necessary

@Jasonqi146
Copy link
Member

Sounds good! I will update the repo later in the after noon.

Hi @XuhuiZhou thanks pointing this out. I think it definitely looks good. If we are planning to add one leaderboard for multiple pages. I believe the repo might be renamed as something like sotopia-webui instead of the current demo. cc @Jasonqi146

Right, that's a good point! Something like sotopia-space? We might have other tabs as well in the gradio application

Sounds good! I will update the repo later in the after noon.

@Jasonqi146
Copy link
Member

Hi @Algoroxyolo @XuhuiZhou , I've renamed both repos. Please see https://huggingface.co/spaces/wdplx/sotopia-space as our new website.

@lwaekfjlk
Copy link
Member

@Algoroxyolo I think we fixed the UI for agent and scenario. Free to create a PR for leaderboard.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants