4 Commits

Author	SHA1	Message	Date
Kawrakow	62122c1950	Cosmetics	2024-06-22 12:02:49 +03:00
Kawrakow	fb8bc26dc5	iqk_mul_mat: Arm implementation for iq2_xxs (llama.cpp version) ... We get ~5% speeedup for TG-128, 3X for PP-512	2024-06-22 12:02:49 +03:00
Kawrakow	a18a564e54	iqk_mul_mat: faster q3_K TG ... We get 31 t/s up from 26 t/s, but we need to treat PP differently from TG, else we get a ~10% drop in PP performance.	2024-06-22 12:02:49 +03:00
Kawrakow	d434b4751a	iqk_mul_mat for llama.cpp	2024-06-22 12:02:49 +03:00