Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Screen capture for multimodal models #1515

Open
kunzaatko opened this issue Oct 11, 2024 · 0 comments
Open

Screen capture for multimodal models #1515

kunzaatko opened this issue Oct 11, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@kunzaatko
Copy link

The Claude chat now allows you to add a screenshot of your screen with a single button. This is a common scenario, where you are usually adding an image of your screen for the model as a context. I take the screenshot and save it to the clipboard and then upload it. A single button such as in Claude would be a great quality of life improvement.

Here are some screenshots from the Claude user interface of this feature:
2024-10-11_17-38
2024-10-11_17-39
2024-10-11_17-39_1
2024-10-11_17-39_2

The core functionality is already present. This is just a convenience. I suppose there is a high-level API in typescript for requesting a screen-capture? I can try to implement it if you assign me.

@kunzaatko kunzaatko added the enhancement New feature or request label Oct 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant