ik_llama_opt

Commit Graph

Author	SHA1	Message	Date
Samuel Oliveira Alves	260622faf6	Self-decoding: Adds support for suffix decoding (#1646 ) * speculative: implement suffix-tree decoder * speculative: add support to cache and tuner	2026-04-18 16:10:10 +02:00
Samuel Oliveira Alves	3de81530c5	Allow tuning of the best args for speculative decoding. (#1595 ) * wip: build spec tuner for spefic args * wip: test different reward system * spec-tune: fix the reward to find best params given a good TPS * spec-tune: refactor logic for its own file * minor clean for comments and modules	2026-04-08 08:02:42 +02:00

Author

SHA1

Message

Date

Samuel Oliveira Alves

260622faf6

Self-decoding: Adds support for suffix decoding (#1646 )

* speculative: implement suffix-tree decoder

* speculative: add support to cache and tuner

2026-04-18 16:10:10 +02:00

Samuel Oliveira Alves

3de81530c5

Allow tuning of the best args for speculative decoding. (#1595 )

* wip: build spec tuner for spefic args

* wip: test different reward system

* spec-tune: fix the reward to find best params given a good TPS

* spec-tune: refactor logic for its own file

* minor clean for comments and modules

2026-04-08 08:02:42 +02:00

2 Commits