ik_llama_opt/gguf-py/gguf
saood06 a7e5b01540 Fix missing rope_freqs with convert_hf_to_gguf (#402)
* lora : fix llama conversion script with ROPE_FREQS

* convert : refactor rope_freqs generation

This should also fix vocab-only conversion for Phi-3.

* convert : adapt MiniCPM3 to separate rope_freqs insertion

MiniCPM3's tokenizer is treated as a SentencePiece tokenizer to avoid
having to run its custom Python code which mixes tokenization
in the same file as tool calls.

gguf-py : add long and short RoPE factors to tensor mappings

Empty, but the key names are used to populate the mappings.

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Co-authored-by: Francis Couture-Harpin <git@compilade.net>
2025-05-09 09:17:41 -05:00
..
__init__.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
constants.py Fix missing rope_freqs with convert_hf_to_gguf (#402) 2025-05-09 09:17:41 -05:00
gguf.py gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981) 2023-11-11 08:04:50 +03:00
gguf_reader.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
gguf_writer.py Deepseek V3 support added (#176) 2025-01-23 18:24:10 +02:00
lazy.py Merge mainline - Aug 12 2024 (#17) 2024-08-12 15:14:32 +02:00
metadata.py Merge mainline - Aug 12 2024 (#17) 2024-08-12 15:14:32 +02:00
py.typed convert : various script cleanups/fixes + merges and special token handling (#2842) 2023-08-30 11:25:50 +03:00
quants.py Merge mainline - Aug 12 2024 (#17) 2024-08-12 15:14:32 +02:00
tensor_mapping.py Fix missing rope_freqs with convert_hf_to_gguf (#402) 2025-05-09 09:17:41 -05:00
utility.py Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
vocab.py Support for Llama-3-Nemotron models (#377) 2025-05-09 10:09:59 +03:00