Kawrakow 6658922b94 Use Q8_K_128 for IQ1_S_R4 and IQ1_M_R4 matrix multiplications (#194) ... * iq1_s_r4: Use Q8_K_128 instead of Q8_1_X4 for gemm (AVX2/Zen4) * iq1_m_r4: Use Q8_K_128 instead of Q8_1_X4 for gemm (AVX2/Zen4) * iq1_s_r4: Use Q8_K_128 instead of Q8_1_X4 for gemm (Neon) * iq1_m_r4: Use Q8_K_128 instead of Q8_0_X4 for gemm (Neon) * Simdify q8_K128 quantization also on Neon * Cleanup --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>		2025-02-09 09:14:52 +02:00
..
cmake	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
include	Use Q8_K_128 for IQ1_S_R4 and IQ1_M_R4 matrix multiplications (#194)	2025-02-09 09:14:52 +02:00
src	Use Q8_K_128 for IQ1_S_R4 and IQ1_M_R4 matrix multiplications (#194)	2025-02-09 09:14:52 +02:00
.gitignore	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
CMakeLists.txt	Move to c++17 projectwide (#80)	2024-10-04 14:43:26 +03:00