Kawrakow 77396a74b5 Better FlashMLA (#243) ... * This is a better FA for TG It should benefit MLA and GQA. Tested to work with DeepSeek-Lite MLA, not yet for GQA. For tg64@pp8192 it is ~13% faster than MLA without FA, and 57% faster that the main branch FA. * WIP * Cleanup --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>		2025-03-07 09:46:58 +02:00
..
cmake	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
include	SER - Smart Expert Reduction (#239)	2025-03-02 13:47:38 +02:00
src	Better FlashMLA (#243)	2025-03-07 09:46:58 +02:00
.gitignore	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
CMakeLists.txt	FA: Add option to build all FA kernels (#197)	2025-02-09 18:59:33 +02:00