how to load a offline local model file?

[adaaaaaa]

download from https://huggingface.co/TheBloke/phi-2-GGUF/blob/main/phi-2.Q6_K.gguf
how to load this file?

[welcome]

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! 🤗

If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively.

You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! 👋

Welcome to the Jupyter community! 🎉

[JasonWeill]

Hi @adaaaaaa ! Jupyter AI doesn't currently have a facility to load GGUF models like the one you linked above. Issue #408 concerns additional ways to register local models; let's keep the conversation going there. Thank you for your contribution!