nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/github-data/pull_requests/50 - AVX2 Flash Attention 2.md

319 B
Raw Blame History

🔀 #50 - AVX2 Flash Attention 2

Author ikawrakow
State ❌ Closed
Created 2024-09-11
Updated 2024-09-11

Description

This PR adds the ability to use Q4_0, Q4_1 and Q8_0 for the kv-cache.