You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Current implementation is multiplying Float32 number in range (-1,1) by 0xFFFF which is eqvivalent to 65535. I found that with this conversion data is incorrect.
By som googling I found that using this:
num < 0 ? num * 0x8000 : num * 0x7FFF;
Im getting results equivalent to numpy implementation.
Is this a issue or I got something wrong ?
The text was updated successfully, but these errors were encountered:
Current implementation is multiplying Float32 number in range (-1,1) by 0xFFFF which is eqvivalent to 65535. I found that with this conversion data is incorrect.
By som googling I found that using this:
Im getting results equivalent to numpy implementation.
Is this a issue or I got something wrong ?
The text was updated successfully, but these errors were encountered: