ik_llama_opt/examples/server/webui_llamacpp/src/lib
Samuel Oliveira Alves f4f4b3ff26
Allow dual speculative decoding (#1789)
* wip: test logic to use multiple specs

* feat: introduce composite speculative decoding stages

* handle MTP context and draft invalidation

* fix: allow gemma mtp for speculative stages

* fix: normalize spec stage keys

* refactor: remove enable_mtp flag and improve speculative stage handling

* fix: update cached text tokens handling for stage chains

* feat: implement sync for external MTP after non-MTP accept
2026-05-15 10:10:40 +03:00
..
components webui update (#1003) 2025-11-24 07:03:45 +01:00
constants webui update (#1003) 2025-11-24 07:03:45 +01:00
enums webui update (#1003) 2025-11-24 07:03:45 +01:00
hooks Add --webui arg to launch llama.cpp new webui (#786) 2025-10-27 14:22:02 +02:00
markdown Add --webui arg to launch llama.cpp new webui (#786) 2025-10-27 14:22:02 +02:00
services Autoparser - complete refactoring of parser architecture (#1376) 2026-04-22 10:04:13 +02:00
stores webui update (#1003) 2025-11-24 07:03:45 +01:00
types Allow dual speculative decoding (#1789) 2026-05-15 10:10:40 +03:00
utils webui update (#1003) 2025-11-24 07:03:45 +01:00