Skip to content

Properly shard kv cache in attention #16

Properly shard kv cache in attention

Properly shard kv cache in attention #16

Annotations

1 warning

build-and-test-job (b)

succeeded Dec 2, 2024 in 9m 57s
Set up job
2s
Run actions/checkout@v4
1s
Run docker/setup-buildx-action@v3
3s
Gather test files
0s
Split test files into groups
0s
Select a test group
0s
Read test inputs
0s
Run tests
9m 36s
Post Run tests
7s
Post Run docker/setup-buildx-action@v3
4s
Post Run actions/checkout@v4
0s
Complete job
0s