Kawrakow ee274a4148 iqk_mul_mat: better iq4_nl implementation on Zen4/AVX2 (#72) ... * iqk_mul_mat: better iq4_nl implementation on Zen4/AVX2 PP-512 performance for LLaMA-3.1-8B goes to 162.6 t/s up from 133.2 t/s. * Fix AVX2 In addition to fixing iq4_nl, it seems I never adhusted the AVX2 implementation for iq2_tn to the block scale removal? This commit also fixes that. --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>		2024-10-01 10:56:50 +03:00
..
cmake	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
include	Adding SWIGLU unary op (#65)	2024-09-28 13:37:25 +03:00
src	iqk_mul_mat: better iq4_nl implementation on Zen4/AVX2 (#72)	2024-10-01 10:56:50 +03:00
.gitignore	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
CMakeLists.txt	Merge mainline - Aug 12 2024 (#17)	2024-08-12 15:14:32 +02:00