ik_llama_opt/ggml
Kawrakow 5fc4676522 Optimized GEMM/GEMV for IQ1_S (#212)
* Adding iq1_s to iqk_mul_mat (Zen4)

* iq1_s: slightly better on Zen4

* iq1_s: AVX2

* iq1s: NEON

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-02-20 12:41:45 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include Q8_KV: 8-bit quantization type targeting the KV cache (#208) 2025-02-19 11:47:07 +02:00
src Optimized GEMM/GEMV for IQ1_S (#212) 2025-02-20 12:41:45 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt FA: Add option to build all FA kernels (#197) 2025-02-09 18:59:33 +02:00