You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In line 963 of the ttt.py, the shape of eta_mini_batch is [B, nh, K, 1], and in line 981, the shape of torch.tril(eta_mini_batch) is ought to be [B,nh,K,K]. However, the output shape of torch.tril([B, nh, K, 1]) is [B, nh, K, 1] rather than [B,nh,K,K]. May I know why the issue happens? Thanks!
The text was updated successfully, but these errors were encountered:
In line 963 of the ttt.py, the shape of eta_mini_batch is [B, nh, K, 1], and in line 981, the shape of torch.tril(eta_mini_batch) is ought to be [B,nh,K,K]. However, the output shape of torch.tril([B, nh, K, 1]) is [B, nh, K, 1] rather than [B,nh,K,K]. May I know why the issue happens? Thanks!
The text was updated successfully, but these errors were encountered: