nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/gguf-py/gguf
History
Kawrakow 0ceeb11721 Merge mainline llama.cpp (#3) 
* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
 		2024-07-27 07:55:01 +02:00
..
__init__.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
constants.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
gguf.py gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981) 2023-11-11 08:04:50 +03:00
gguf_reader.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
gguf_writer.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
lazy.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
metadata.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
py.typed convert : various script cleanups/fixes + merges and special token handling (#2842) 2023-08-30 11:25:50 +03:00
quants.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
tensor_mapping.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
utility.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
vocab.py Move convert.py to examples/convert-legacy-llama.py (#7430) 2024-05-30 21:40:00 +10:00