ik_llama_opt

Commit Graph

Author	SHA1	Message	Date
Sigbjørn Skjæret	10579b6e66	Fix --split-max-size (#6655 ) * Fix --split-max-size Byte size calculation was done on int and overflowed. * add tests.sh * add examples test scripts to ci run Will autodiscover examples//tests.sh scripts and run them. move WORK_PATH to a subdirectory * clean up before and after test * explicitly define which scripts to run * add --split-max-size to readme	2024-04-14 13:12:59 +02:00
Pierrick Hymbert	1b5523dc79	gguf-split: split and merge gguf per batch of tensors (#6135 ) * gguf-split: split and merge gguf files per tensor * gguf-split: build with make toolchain * gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split * split : minor style + fix compile warnings * gguf-split: remove --upload not implemented --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-03-19 12:05:44 +01:00

Author

SHA1

Message

Date

Sigbjørn Skjæret

10579b6e66

Fix --split-max-size (#6655 )

* Fix --split-max-size

Byte size calculation was done on int and overflowed.

* add tests.sh

* add examples test scripts to ci run

Will autodiscover examples/*/tests.sh scripts and run them.

* move WORK_PATH to a subdirectory

* clean up before and after test

* explicitly define which scripts to run

* add --split-max-size to readme

2024-04-14 13:12:59 +02:00

Pierrick Hymbert

1b5523dc79

gguf-split: split and merge gguf per batch of tensors (#6135 )

* gguf-split: split and merge gguf files per tensor

* gguf-split: build with make toolchain

* gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split

* split : minor style + fix compile warnings

* gguf-split: remove --upload not implemented

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-03-19 12:05:44 +01:00

2 Commits