Source Code for cadam_8bit_blockwise_grad_bf16

[ionutmodo]

Hi,

I have been looking for the source code of the function cadam_8bit_blockwise_grad_bf16, which is used in the .so library here, but unfortunately I cannot find the code in the files in the csrc folder or by using the search function in GitHub.

I observed that the bitsandbytes library comes with pre-compiled .so files and the function cadam_8bit_blockwise_grad_bf16 can be found in the file libbitsandbytes_cuda124.so when I run nm libbitsandbytes_cuda124.so.

In the file pythonInterface.cpp I found the macro that dynamically creates these functions (see here), but I still cannot find the code from this exact line linked here.

Can you please help me understand what is the function that's actually called in C when the function lib.cadam_8bit_blockwise_grad_bf16 is called in python?

Thank you,
ionut

[gau-nernst]

All CUDA kernels should be here I think: https://github.com/bitsandbytes-foundation/bitsandbytes/blob/main/csrc/kernels.cu