VisionOS Metal not supported?

[simoninithomas]

Hey there 👋 ,

I'm testing Whisper.unity on VisionOS. And what it looks like is that we can't run Metal on VisionOS.

What I did:

• I tried to modified the Libwhisper_metal (in MacOS) plugin to accept VisionOS platform. But this lead to errors when running on Simulation.

I'm wondering then if it's possible to run Whisper with metal on Vision Pro 🤔

Thanks for your help

[Macoron]

Unfortunately, there are no libraries compiled with Metal-support for iOS and VisionOS. No particular reason, just didn't get around to do it and test it.

Though it should be relatively easy to fix, you would need to change cmake flags here.

[simoninithomas]

Hi thanks and sorry for the delay.

I compiled for VisionOS lib with metal: https://github.com/simoninithomas/whisper.unity/actions/runs/11919423718

But unfortunately it's still super slow. It looks like the VisionPro continue to run it on CPU.

For now the best solution looks like to use very small models like tiny or small.