2 Commits

Author	SHA1	Message	Date
Johannes Gäßler	6fe8769d65	CUDA: deduplicate FlashAttention code (#7352)	2024-05-18 12:36:25 +02:00
Johannes Gäßler	871641d19e	CUDA: add FP32 FlashAttention vector kernel (#7188) ... * CUDA: add FP32 FlashAttention vector kernel * fixup! CUDA: add FP32 FlashAttention vector kernel * fixup! fixup! CUDA: add FP32 FlashAttention vector kernel * fixup! fixup! fixup! CUDA: add FP32 FlashAttention vector kernel	2024-05-12 19:40:45 +02:00