ik_llama_opt

Commit Graph

Author	SHA1	Message	Date
saood06	5c0a01bdaf	Deepseek V3 support added (#176 ) Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>	2025-01-23 18:24:10 +02:00
Kawrakow	0ceeb11721	Merge mainline llama.cpp (#3 ) * Merging mainline - WIP * Merging mainline - WIP AVX2 and CUDA appear to work. CUDA performance seems slightly (~1-2%) lower as it is so often the case with llama.cpp/ggml after some "improvements" have been made. * Merging mainline - fix Metal * Remove check --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>	2024-07-27 07:55:01 +02:00

Author

SHA1

Message

Date

saood06

5c0a01bdaf

Deepseek V3 support added (#176 )

Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>

2025-01-23 18:24:10 +02:00

Kawrakow

0ceeb11721

Merge mainline llama.cpp (#3 )

* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2024-07-27 07:55:01 +02:00

2 Commits