Uploading GGUF Models to GCP

[KickItLikeShika]

are GGUF optimized models supported?

[nlathia]

Is this using huggingface @KickItLikeShika?

It's tricky to keep modelstore fully up to date with HF, but one straightforward alternative you can have is to save the file and use modelstore to save the file:
https://modelstore.readthedocs.io/en/latest/concepts/libraries.html#what-to-do-if-a-library-is-not-supported

[KickItLikeShika]

Nope, it's using llama.cpp, but GGUF formats are supported in HF
thanks for dropping the link, will give it a look