ik_llama_opt/src
Kawrakow f90b4c2f27
Full graph parallel for Qwen3.5 (dense and MoE) (#1388)
* WIP

* WIP

* WIP

* WIP

* WIP

* WIP

* WIP

Loads and starts running, crashes with illegal memory access in
quantize_mmq_q8_1. This almost always indicates NaNs in the input
to the MoE FFN part.

* WIP

* WIP

Loads and runs, wrong results (very high PPL)
Performance looks promising, around 25% better than previous sm graph.
Needs f32 or bf16 graph reduce type.

* WIP - still wrong

* Fix after rebase

* WIP

* WIP

* This seems to be working for dense Qwen3.5!!!

* WIP: Qwen3-Next is not quite working

* Some cleanup

* Disable Qwen3-Next for now

* Disable graph parallel when mmproj was specified

* Read/write split recurrent state

* That should not crash

* Re-enable vision - it works now

* Recurrent layers should now be counted for split cache
2026-03-10 09:08:24 +01:00
..
CMakeLists.txt Factor out delta net (#1286) 2026-02-18 17:16:17 +01:00
llama-arch.cpp iAdding support for dense Qwen-3.5 models (#1326) 2026-02-26 08:51:01 +01:00
llama-arch.h iAdding support for dense Qwen-3.5 models (#1326) 2026-02-26 08:51:01 +01:00
llama-build-context.cpp Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-build-context.h iAdding support for dense Qwen-3.5 models (#1326) 2026-02-26 08:51:01 +01:00
llama-context.h Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-cparams.h Bring back #1333 and #1335 (#1340) 2026-02-28 14:31:42 +01:00
llama-delta-net.cpp Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-delta-net.h Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-grammar.cpp llama : add token matching support to llama-grammar (#1220) 2026-02-03 07:57:17 +02:00
llama-grammar.h llama : add token matching support to llama-grammar (#1220) 2026-02-03 07:57:17 +02:00
llama-hparams.cpp Add all Qwen3.5 model types (#1378) 2026-03-07 09:01:33 +01:00
llama-hparams.h Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-impl.h Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-load-tensors.cpp Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-mmap.cpp Fix clang warnings on macOS (#1354) 2026-03-03 16:27:16 +01:00
llama-mmap.h Enable CUDA graphs for MoE models + GPT-OSS support (#689) 2025-08-15 09:18:07 +03:00
llama-model-loader.cpp Be able to read uint32_t and bool arrays from GGUFs (#1252) 2026-02-07 19:20:15 +02:00
llama-model-loader.h Be able to quantize mmproj files (#1367) 2026-03-06 07:25:40 +01:00
llama-model.cpp Add all Qwen3.5 model types (#1378) 2026-03-07 09:01:33 +01:00
llama-model.h Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
llama-quantize.cpp Be able to quantize mmproj files (#1367) 2026-03-06 07:25:40 +01:00
llama-sampling.cpp fix adaptive p sampler rewinding too far back (#1359) 2026-03-04 13:26:25 +01:00
llama-sampling.h fix adaptive p sampler rewinding too far back (#1359) 2026-03-04 13:26:25 +01:00
llama-vocab.cpp Qwen3.5-MoE support (#1288) 2026-02-21 08:33:06 +01:00
llama-vocab.h Qwen3.5-MoE support (#1288) 2026-02-21 08:33:06 +01:00
llama.cpp Full graph parallel for Qwen3.5 (dense and MoE) (#1388) 2026-03-10 09:08:24 +01:00
unicode-data.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-data.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode.cpp Server: refactor and rename functions (#1151) 2026-01-18 08:16:57 +02:00
unicode.h Enable CUDA graphs for MoE models + GPT-OSS support (#689) 2025-08-15 09:18:07 +03:00