nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/src
History
Kawrakow 978202a754
Merge ffn_up and ffn_gate experts tensors (part 2) (#1139) 
* Add ability to merge up+gate exps to more models

* We need to of course pass the merged tensor to build_ffn

* All the others

* Also Qwen3VL-MoE

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
 		2026-01-13 08:07:52 +02:00
..
CMakeLists.txt Enable and clean up compiler warnings in src (#824) 2025-10-11 16:01:13 +03:00
llama-arch.cpp Mimo-V2-Flash support (#1096) 2026-01-05 08:00:01 +02:00
llama-arch.h Mimo-V2-Flash support (#1096) 2026-01-05 08:00:01 +02:00
llama-build-context.cpp Merge ffn_up and ffn_gate experts tensors (part 2) (#1139) 2026-01-13 08:07:52 +02:00
llama-build-context.h Merge ffn_up and ffn_gate experts tensors (#1137) 2026-01-12 18:30:53 +02:00
llama-context.h POC: CUDA tensor parallel (MoE models) (#1022) 2025-12-01 19:25:40 +01:00
llama-cparams.h Async compute graph evaluation (2 or more GPUs) (#1089) 2025-12-27 08:18:06 +01:00
llama-grammar.cpp Update grammar (#1023) 2025-11-30 18:45:38 +01:00
llama-grammar.h Update grammar (#1023) 2025-11-30 18:45:38 +01:00
llama-hparams.cpp Mimo-V2-Flash support (#1096) 2026-01-05 08:00:01 +02:00
llama-hparams.h Mimo-V2-Flash support (#1096) 2026-01-05 08:00:01 +02:00
llama-impl.h server: stop processing the prompt when client disconnects (#1134) 2026-01-13 07:56:59 +02:00
llama-load-tensors.cpp Merge ffn_up and ffn_gate experts tensors (part 2) (#1139) 2026-01-13 08:07:52 +02:00
llama-mmap.cpp Enable CUDA graphs for MoE models + GPT-OSS support (#689) 2025-08-15 09:18:07 +03:00
llama-mmap.h Enable CUDA graphs for MoE models + GPT-OSS support (#689) 2025-08-15 09:18:07 +03:00
llama-model-loader.cpp Merge ffn_up and ffn_gate experts tensors (#1137) 2026-01-12 18:30:53 +02:00
llama-model-loader.h Merge ffn_up and ffn_gate experts tensors (#1137) 2026-01-12 18:30:53 +02:00
llama-model.cpp Mimo-V2-Flash support (#1096) 2026-01-05 08:00:01 +02:00
llama-model.h Merge ffn_up and ffn_gate experts tensors (#1137) 2026-01-12 18:30:53 +02:00
llama-quantize.cpp Merge ffn_up and ffn_gate experts tensors (#1137) 2026-01-12 18:30:53 +02:00
llama-sampling.cpp Implement Adaptive-P Sampler (#1100) 2026-01-10 07:58:53 +02:00
llama-sampling.h Implement Adaptive-P Sampler (#1100) 2026-01-10 07:58:53 +02:00
llama-vocab.cpp Update mtmd to improve accuracy of M-RoPE (#993) 2025-11-29 07:27:15 +01:00
llama-vocab.h Update mtmd to improve accuracy of M-RoPE (#993) 2025-11-29 07:27:15 +01:00
llama.cpp server: stop processing the prompt when client disconnects (#1134) 2026-01-13 07:56:59 +02:00
unicode-data.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-data.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode.cpp Enable CUDA graphs for MoE models + GPT-OSS support (#689) 2025-08-15 09:18:07 +03:00
unicode.h Enable CUDA graphs for MoE models + GPT-OSS support (#689) 2025-08-15 09:18:07 +03:00