nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/src
History
Kawrakow 6d30fa2fe6
Fused indexer top_k (CPU only) (#2098) 
* Indexer topk op - CPU only

We do save memory, but it is somehow much slower than what we have on
main.

* Make it a command line option
 		2026-07-09 18:04:41 +03:00
..
graphs Fused indexer top_k (CPU only) (#2098) 2026-07-09 18:04:41 +03:00
CMakeLists.txt on-demand tensor reload (#1989) 2026-06-22 16:36:34 +02:00
llama-arch.cpp DFlash: support MiMo-V2.5-Pro draft conversion and runtime (#2048) 2026-06-29 13:26:29 +02:00
llama-arch.h DFlash: support MiMo-V2.5-Pro draft conversion and runtime (#2048) 2026-06-29 13:26:29 +02:00
llama-build-context.cpp deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045) 2026-07-02 09:36:49 +02:00
llama-build-context.h GLM-DSA: improve TG performance even more (#2068) 2026-07-06 11:15:54 +02:00
llama-context.h deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045) 2026-07-02 09:36:49 +02:00
llama-cparams.h Fused indexer top_k (CPU only) (#2098) 2026-07-09 18:04:41 +03:00
llama-delta-net.cpp MTP: faster recurrent state restore (#1791) 2026-05-13 11:00:24 +03:00
llama-delta-net.h MTP: faster recurrent state restore (#1791) 2026-05-13 11:00:24 +03:00
llama-dflash.cpp DFlash: support gpt-oss drafts with attention bias (#2061) 2026-06-30 09:02:18 +02:00
llama-dflash.h DFlash: use persistent FA-ready K/V cache (#1997) 2026-06-22 16:49:35 +02:00
llama-expert-io.h Add --defer-experts flag to defer expert mmap residency on Linux (#1634) 2026-04-16 08:54:44 +02:00
llama-grammar.cpp Bug fixes (#1940) 2026-06-10 07:45:49 +02:00
llama-grammar.h llama : add token matching support to llama-grammar (#1220) 2026-02-03 07:57:17 +02:00
llama-hparams.cpp deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045) 2026-07-02 09:36:49 +02:00
llama-hparams.h deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045) 2026-07-02 09:36:49 +02:00
llama-impl.h Split mode graph for dense Gemma4 assistant (#2022) 2026-06-24 18:29:32 +02:00
llama-load-tensors.cpp deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045) 2026-07-02 09:36:49 +02:00
llama-mmap.cpp Parallelize weight loading for weights targeted at anonymous host ram and also GPU (#2057) 2026-07-07 09:52:19 +02:00
llama-mmap.h Parallelize weight loading for weights targeted at anonymous host ram and also GPU (#2057) 2026-07-07 09:52:19 +02:00
llama-model-loader.cpp Remove deprecated Kompute (Vulkan compute) backend (#2097) 2026-07-08 10:01:01 +02:00
llama-model-loader.h Split mode graph for dense Gemma4 assistant (#2022) 2026-06-24 18:29:32 +02:00
llama-model.cpp DFlash: support MiMo-V2.5-Pro draft conversion and runtime (#2048) 2026-06-29 13:26:29 +02:00
llama-model.h on-demand tensor reload (#1989) 2026-06-22 16:36:34 +02:00
llama-quantize.cpp Merge remote-tracking branch 'origin/main' into feat/dflash-implementation 2026-06-13 17:27:52 -03:00
llama-quantize.h Allow using -rtr and -muge together (#1444) 2026-03-16 18:26:26 +01:00
llama-reload-info.h on-demand tensor reload (#1989) 2026-06-22 16:36:34 +02:00
llama-reload.cpp Split mode graph for dense Gemma4 assistant (#2022) 2026-06-24 18:29:32 +02:00
llama-sampling.cpp Bug fixes (#1940) 2026-06-10 07:45:49 +02:00
llama-sampling.h Add adaptive sampling clone and free functions to manage memory (#1851) 2026-05-21 08:11:17 +03:00
llama-spec-features-dflash.cpp DFlash: use persistent FA-ready K/V cache (#1997) 2026-06-22 16:49:35 +02:00
llama-spec-features-dflash.h clean redudance in dflash graph and small logics (#1994) 2026-06-19 09:04:54 +02:00
llama-spec-features.cpp remove duplicated code and unnecesary refactor 2026-06-14 16:02:02 -03:00
llama-spec-features.h move dflash for it own file 2026-06-02 10:22:13 -03:00
llama-vocab.cpp model: add Cohere2-MoE North Mini Code support (#1945) 2026-06-10 15:28:27 +02:00
llama-vocab.h Add Mellum2 architecture support (#1919) 2026-06-04 14:28:02 +02:00
llama.cpp Fused indexer top_k (CPU only) (#2098) 2026-07-09 18:04:41 +03:00
unicode-data.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-data.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-script-data.cpp Add Unicode allowlist (#1597) 2026-04-10 18:22:57 +02:00
unicode.cpp Gemma4 tokenizer fixes (#1603) 2026-04-09 15:33:28 +02:00
unicode.h Add Unicode allowlist (#1597) 2026-04-10 18:22:57 +02:00