nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/github-data/pull_requests/137 - Fix AVX2 implementati...

486 B
Raw Permalink Blame History

🐛 #137 - Fix AVX2 implementation of iq4_nl_r4

Author ikawrakow
State ❌ Closed
Created 2024-12-11
Updated 2024-12-11

Description

The implementation was using _mm256_maddubs_epi16, which overflows (and gets saturated) with the unsigned version of the non-linear quants IQ4_NL lookup table. This PR fixes it without a noticeable performance loss.