Code

Enable bwd for flash_attention#74

Code

Closed

xuzhao9 wants to merge 11 commits intomainpytorch-labs/tritonbench:mainfrom xz9/fix-attn-bwdpytorch-labs/tritonbench:xz9/fix-attn-bwdCopy head branch name to clipboard

+62-37

Commits

Commits on Nov 22, 2024

• Run bwd for flash_attention

  xuzhao9

  committed
  88e1ae5

• Fix bwd

  xuzhao9

  committed
  f5facab

• Fix flash_attention test

  xuzhao9

  committed
  6270375

• xformers-splitk does not support backward

  xuzhao9

  committed
  3880db3

• xformers_splitk does not have backward

  xuzhao9

  committed
  1c7d24f

• Only enable backends that has backward

  xuzhao9

  committed
  f3a26d5

• When skip is specified, skip the backward if it is not applicable.

  xuzhao9

  committed
  1bf76c1

• Set runnable backends

  xuzhao9

  committed
  30b66ad

• Bugfix

  xuzhao9

  committed
  0f3e878

• Add test

  xuzhao9

  committed
  03a64c0

• Fix lint

  xuzhao9

  committed
  b1813a1