Whisper doesn't use GPU even enabled CUDA

[ThanhVux011]

The sample runs very fast and uses the GPU, while my project consumes a lot of CPU even though I have enabled CUDA in the settings.
I installed CUDE toolkit 12.2.0 and my unity version is 2022.3.47f1 , i tried to reinstall whisper and CUDA but none of them work

[Macoron]

For wich platform is targeted your project in Project Settings? Have you tried testing it in the build? What GPU do you have?

[ThanhVux011]

My project target platform is PC , i build both my project and your sample and the result is still the same , i'm using RTX 4070

[Macoron]

Can you double check that in the Project Settings/Player/Scripting Define Symbols you have WHISPER_CUDA define? I checked on my PC, and I usually get clear 10x-15x speed up with enabled CUDA.

[MauritsDijkman]

Hey ThanhVux011, did you manage to make it work? I have the same issue on my end (also when trying it in the demo project). The 'WHISPER_CUDA' is defined in the Scripting Define Symbols.

I get the following error when trying to use CUDA: "DllNotFoundException: libwhisper_cuda assembly: type: member:(null)"

[Macoron]

@MauritsDijkman are you getting slow transcription or you don't get any results (only error)?

[MauritsDijkman]

@MauritsDijkman are you getting slow transcription or you don't get any results (only error)?

Hey Macoron, thank you for the fast reply! I only get the error when going into playmode and it tries to load the Whisper model. It doesn't allow for transcription at that point.
Is there a setting or value that I should perhaps change?