Chnage KQ mask padding to 64 (#574)
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
This commit is contained in:
parent
59e3f4ffe7
commit
c482d14b12
|
|
@ -1957,7 +1957,7 @@ extern "C" {
|
|||
int min_entries,
|
||||
float thresh);
|
||||
|
||||
#define GGML_KQ_MASK_PAD 32
|
||||
#define GGML_KQ_MASK_PAD 64
|
||||
|
||||
// q: [n_embd, n_batch, n_head, 1]
|
||||
// k: [n_embd, n_kv, n_head_kv, 1]
|
||||
|
|
|
|||
Loading…
Reference in New Issue