Kawrakow
|
a407b9ca3d
|
Fix Qwen3.6-MoE low MTP acceptance rate (#1815)
* Fix Qwen3.6-MoE low MTP acceptance rate
* Fix Gemma4 MTP
|
2026-05-18 07:26:17 +03:00 |
Samuel Oliveira Alves
|
0fcffdb64d
|
feat: map Gemma 4 tensor and support with imatrix (#1796)
|
2026-05-14 09:01:24 +03:00 |
|
Kawrakow
|
86b5d076c5
|
Gemma4 MTP: avoid casting KV cache to f32 (#1786)
|
2026-05-13 09:11:27 +03:00 |
|
Samuel Oliveira Alves
|
c2b8bca807
|
Add MTP Support for Gemma 4 (#1744)
* gemma-mtp: build the arch to load the MTP model
* gemma-mtp: fix mtp kv state
* gemma-mtp: refactor some functions and create gguf
* gemma-mtp: make usable for embeddings models variant
* gemma-mtp: fix qwen mtp load in graph split
* gemma-mtp: refactor tensor creation and adjust output tensor handling
* Gemma 4 MTP: improve tensor handling, and adjust split mode logic
|
2026-05-10 07:44:20 +03:00 |
|
Kawrakow
|
8befd92ea5
|
Refactor model compute graphs (#1651)
* Refactor model compute graphs
* Remove unused function
|
2026-04-18 17:08:43 +02:00 |