-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Summary: Add linter to make sure PR is consistent with internal `arc lint`. To format the code, run the following in the repo directory: ``` ufmt format . ``` We also test 25 operators in our H100 CI. Note that many of the flash_attention backends do not work right now and we need to fix them. Pull Request resolved: #47 Reviewed By: FindHao Differential Revision: D65709181 Pulled By: xuzhao9 fbshipit-source-id: 5b013906e7b04c8ee41d74db5756de08eec5b5b2
- Loading branch information
1 parent
7b4a0eb
commit 359dfb4
Showing
29 changed files
with
206 additions
and
106 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -8,4 +8,7 @@ fi | |
|
||
. "${SETUP_SCRIPT}" | ||
|
||
# install deps | ||
pip install psutil tabulate | ||
|
||
python -m unittest test.test_gpu.main |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,29 @@ | ||
name: Linter | ||
on: | ||
pull_request: | ||
push: | ||
branches: | ||
- main | ||
workflow_dispatch: | ||
|
||
jobs: | ||
pylint: | ||
permissions: | ||
contents: read | ||
runs-on: ubuntu-latest | ||
steps: | ||
- name: Checkout | ||
uses: actions/checkout@v3 | ||
with: | ||
path: tritonbench | ||
- name: Install deps | ||
run: | | ||
pip install ruff-api==0.1.0 | ||
- name: Check Formatting | ||
uses: omnilib/ufmt@action-v1 | ||
with: | ||
path: tritonbench | ||
|
||
concurrency: | ||
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.sha }}-${{ github.event_name == 'workflow_dispatch' }} | ||
cancel-in-progress: true |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
[tool.ufmt] | ||
formatter = "ruff-api" | ||
excludes = ["submodules/"] | ||
|
||
[tool.black] | ||
line-length = 88 | ||
target-version = ["py312"] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,5 @@ | ||
packaging | ||
pynvml | ||
psutil | ||
tabulate | ||
transformers==4.46.1 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,11 +1,37 @@ | ||
# Tests we skip in OSS CI | ||
# This file is regarding to the Triton version bundled with pytorch | ||
# Use <op-name> to skip an entire operator | ||
# Use <op-name/impl-name> to skip an impl | ||
- test_op | ||
- bf16xint16_gemm/bf16xint16 | ||
- fp8_attention/colfax_fmha | ||
- fp8_fused_quant_gemm_rowwise | ||
- fp8_gemm/triton_persistent_fp8_gemm | ||
- fp8_gemm/triton_tma_persistent_fp8_gemm | ||
- fp8_gemm_rowwise | ||
# Use <op-name:> to skip an entire operator | ||
# Use <op-name:\n - impl-name> to skip an impl | ||
bf16xint16_gemm: | ||
- bf16xint16 | ||
# TODO: we have many buggy backends for flash_attention | ||
# Need to fix them in the CI | ||
flash_attention: | ||
# - triton_tutorial_flash_v2_tma | ||
# - triton_op_flash_v2 | ||
# - xformers_splitk | ||
# - colfax_cutlass | ||
# - tk | ||
# - sdpa | ||
# - cudnn | ||
# - flex_attention | ||
fp8_attention: | ||
- colfax_fmha | ||
fp8_fused_quant_gemm_rowwise: | ||
fp8_gemm: | ||
- triton_persistent_fp8_gemm | ||
- triton_tma_persistent_fp8_gemm | ||
fp8_gemm_rowwise: | ||
gemm: | ||
grouped_gemm: | ||
int4_gemm: | ||
jagged_layer_norm: | ||
jagged_mean: | ||
jagged_softmax: | ||
jagged_sum: | ||
layer_norm: | ||
low_mem_dropout: | ||
rms_norm: | ||
rope: | ||
template_attention: | ||
test_op: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.