nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/models
History
Kawrakow 0ceeb11721 Merge mainline llama.cpp (#3) 
* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
 		2024-07-27 07:55:01 +02:00
..
.editorconfig
…
ggml-vocab-aquila.gguf
…
ggml-vocab-baichuan.gguf
…
ggml-vocab-bert-bge.gguf
…
ggml-vocab-bert-bge.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-bert-bge.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-command-r.gguf
…
ggml-vocab-command-r.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-command-r.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-deepseek-coder.gguf
…
ggml-vocab-deepseek-coder.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-deepseek-coder.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-deepseek-llm.gguf
…
ggml-vocab-deepseek-llm.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-deepseek-llm.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-falcon.gguf
…
ggml-vocab-falcon.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-falcon.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-gpt-2.gguf
…
ggml-vocab-gpt-2.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-gpt-2.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-gpt-neox.gguf
…
ggml-vocab-llama-bpe.gguf
…
ggml-vocab-llama-bpe.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-llama-bpe.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-llama-spm.gguf
…
ggml-vocab-llama-spm.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-llama-spm.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-mpt.gguf
…
ggml-vocab-mpt.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-mpt.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-phi-3.gguf
…
ggml-vocab-phi-3.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-phi-3.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-qwen2.gguf
…
ggml-vocab-qwen2.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-qwen2.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-refact.gguf
…
ggml-vocab-refact.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-refact.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-starcoder.gguf
…
ggml-vocab-starcoder.gguf.inp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
ggml-vocab-starcoder.gguf.out Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00