ik_llama_opt/src
Kawrakow 022bd00aab
Optimize Cohere2-MoE graph parallel (#1948)
* Optimzie Cohere2-MoE graph parallel

* Minor
2026-06-11 07:26:42 +02:00
..
graphs Optimize Cohere2-MoE graph parallel (#1948) 2026-06-11 07:26:42 +02:00
CMakeLists.txt model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-arch.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-arch.h model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-build-context.cpp Optimize Cohere2-MoE graph parallel (#1948) 2026-06-11 07:26:42 +02:00
llama-build-context.h Optimize Cohere2-MoE graph parallel (#1948) 2026-06-11 07:26:42 +02:00
llama-context.h Add extra nodes when dealing with MLA and amb (#1899) 2026-05-29 15:17:24 +03:00
llama-cparams.h MLA tensor parallelism under -sm graph (DEEPSEEK2/GLM_DSA/MISTRAL4) (#1821) 2026-05-19 08:36:17 +03:00
llama-delta-net.cpp MTP: faster recurrent state restore (#1791) 2026-05-13 11:00:24 +03:00
llama-delta-net.h MTP: faster recurrent state restore (#1791) 2026-05-13 11:00:24 +03:00
llama-expert-io.h Add --defer-experts flag to defer expert mmap residency on Linux (#1634) 2026-04-16 08:54:44 +02:00
llama-grammar.cpp Bug fixes (#1940) 2026-06-10 07:45:49 +02:00
llama-grammar.h llama : add token matching support to llama-grammar (#1220) 2026-02-03 07:57:17 +02:00
llama-hparams.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-hparams.h model: add Poolside Laguna XS.2 support (#1911) 2026-06-08 18:33:12 +02:00
llama-impl.h Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-load-tensors.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-mmap.cpp Add --defer-experts flag to defer expert mmap residency on Linux (#1634) 2026-04-16 08:54:44 +02:00
llama-mmap.h Add --defer-experts flag to defer expert mmap residency on Linux (#1634) 2026-04-16 08:54:44 +02:00
llama-model-loader.cpp fix: use int8_t for GGUF bool array loading instead of platform-dependent bool (#1648) 2026-04-17 07:25:07 +02:00
llama-model-loader.h MTP: option to use re-quantized output tensor for better TG performance (#1809) 2026-05-16 14:40:18 +03:00
llama-model.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-model.h model: add Poolside Laguna XS.2 support (#1911) 2026-06-08 18:33:12 +02:00
llama-quantize.cpp quantize: add exception for Gemma4 (#1897) 2026-05-29 10:54:21 +03:00
llama-quantize.h Allow using -rtr and -muge together (#1444) 2026-03-16 18:26:26 +01:00
llama-sampling.cpp Bug fixes (#1940) 2026-06-10 07:45:49 +02:00
llama-sampling.h Add adaptive sampling clone and free functions to manage memory (#1851) 2026-05-21 08:11:17 +03:00
llama-spec-features.cpp Support for alternative Gemma4 assistant (#1937) 2026-06-09 09:30:12 +02:00
llama-spec-features.h Move embedding management to speculative (#1825) 2026-05-20 17:42:48 +03:00
llama-vocab.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-vocab.h Add Mellum2 architecture support (#1919) 2026-06-04 14:28:02 +02:00
llama.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
unicode-data.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-data.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-script-data.cpp Add Unicode allowlist (#1597) 2026-04-10 18:22:57 +02:00
unicode.cpp Gemma4 tokenizer fixes (#1603) 2026-04-09 15:33:28 +02:00
unicode.h Add Unicode allowlist (#1597) 2026-04-10 18:22:57 +02:00