How do you suggest dealing with CORS protection in the browser while running this?

[Slider2k]

[LostRuins]

While running... what? I need more details.

[Slider2k]

While running this as a standalone HTML.

[LostRuins]

Generally, the only way is to either disable CORS server side, or use a CORS proxy. What are you trying to connect to?

[Slider2k]

Just opening the the local html in the browser and connecting to whatever endpoint. Doesn't seem to be easily possible. One way I've found is disabling CORS security completely for the whole browser run with the cmd line argument, which is obviously not reasonable for normal operation. If only there was an easy way to disable CORS for select sites.

[LostRuins]

There is! It's usually a server configuration.

[Slider2k]

I'm sure there is a configuration for a server. But I'm talking about opening the html from a local drive on the desktop.

[henk717]

I'm sure there is a configuration a server. But I'm talking about opening the html from a local drive on the desktop.

I think you misunderstand, the CORS behavior is decided by what you are connecting to not by us. So if you are using a specific API that does not allow connections from a local file the only thing you can do is connect to another provider that is less strict about ir. The AI Horde and local AI software such as Koboldcpp should not be strict about this. If you have a strong enough PC and value working offline I recommend giving Koboldcpp a try.

[Slider2k]

My mistake, I thought CORS was set on the html serving server.

[henk717]

In your case you definately want to switch to Koboldcpp, that way its already preconfigured and bundled and ready to go straight away. https://koboldai.org/cpp you will be able to use the same models (And technically even more since we preserved legacy support) as you can with llamacpp server, but the backend is custom made to work the best with all the features KoboldAI Lite has to offer and it will host its own bundled copy of KoboldAI Lite so you don't run in to this CORS issue.

[Slider2k]

Thanks, but I was more interested in a general solution of using a local single file html frontend with any supported backend. In that case using a reverse-proxy that inserts needed CORS policy is probably a way to go.