Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate draft reports using LLM #469

Open
SkourtsidisGiorgos opened this issue Sep 18, 2024 · 4 comments
Open

Generate draft reports using LLM #469

SkourtsidisGiorgos opened this issue Sep 18, 2024 · 4 comments

Comments

@SkourtsidisGiorgos
Copy link

It would be amazing if we had a draft report for prospects. We can use the cheapest LLM api to generate these reports

Using this site: https://llmpricecheck.com/ we can compare prices and use the cheapest
image

Example from gpt-4o:
https://chatgpt.com/share/66eace74-e17c-8011-8937-f244e398df49

As this game is free, the only viable way I see this working is this:

  • Developer will pick a company/API that provides LLMs (OpenAI, Anthropic etc) and the user will have the option to enable this feature by providing his API key.

Requirements:

  • Send requests to LLM, get responses, parse text, put this text into draft report. A fast model has to be selected in order to minimize latency
  • Good documentation on how to generate api key, how to enable this feature and where to put the key (tell the users to NEVER share a key)

In order to minimize cost, a "draft report" button will be available for each player. When user clicks it, then app sends the request to LLM API. This draft report can then be stored for each player. Draft reports should be deleted after a few seasons in order not to run out of space. Also, they should not be included in league export-import

If you think this feature has value, we can ask the users in the Reddit community how they feel about this, because people might don't want to pay for these reports or they will find it hard-to-use.

This idea can also be used for other stuff, such as league news or player's background stories

@SkourtsidisGiorgos
Copy link
Author

I have already done the 1st test of LLM usage on users with this post

This was generated using an LLM. Users seems to like it. We could have stories like this for every player included in the Hall of Fame at the end of their careers.
We have to get more user feedback and see if news/stories/draft reports is something they would like

@dumbmatter
Copy link
Member

It's definitely a good idea. Adding a dependency on a third party server side API would introduce a lot of complexity, so I'm not eager to do it. Google is currently experimenting with including a local LLM in Chrome, that would be much easier to use. So I might wait and see how that progresses before I worry more about this.

@SkourtsidisGiorgos
Copy link
Author

SkourtsidisGiorgos commented Sep 18, 2024

I agree, it sounds like it will be complex both for devs and for the users. Maybe it is a bad idea at the moment. You can close this issue if you want.
I will try to allocate some time to look at the source code and maybe I will propose something specific/more structured in the future.

@ericwhitcomb
Copy link

Perhaps a workaround could be a button on the draft prospect's page that when clicked copies the player's details to the clipboard so a user could manually include the details in an LLM prompt for generating a report? Then, with the report generated, the user can go back to the game and copy the report into a text area field on the player's profile? Kind of like how adding a player note works... Just a thought.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants