ik_llama_opt/ggml
Kawrakow e787c00141 Reduce size of compute buffers (#237)
* This reduces compute buffer size for MLA

* This should accomplish it for standard attention

* Much better

* Better concat for contiguous tensors

If all the op does is to concatenate the second tensor
to the first, why would we want to have a loop?

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-03-01 08:25:27 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include Fused MoE ffn_up and ffn_gate (#229) 2025-02-23 14:31:11 +02:00
src Reduce size of compute buffers (#237) 2025-03-01 08:25:27 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt FA: Add option to build all FA kernels (#197) 2025-02-09 18:59:33 +02:00