26113d1dd3
The DSA attention kernel used the shared cublas handle without binding it to the backend's stream, so its Q.K / P.V GEMMs ran on a different stream than the gather and softmax kernels. The softmax could then read the score buffer before the GEMM wrote it, picking up stale (NaN) values. |
||
|---|---|---|
| .. | ||
| cmake | ||
| include | ||
| src | ||
| .gitignore | ||
| CMakeLists.txt | ||