ik_llama_opt/.devops/nix
Kawrakow 0ceeb11721 Merge mainline llama.cpp (#3)
* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-07-27 07:55:01 +02:00
..
apps.nix Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
devshells.nix flake.nix : rewrite (#4605) 2023-12-29 16:42:26 +02:00
docker.nix nix: init singularity and docker images (#5056) 2024-02-22 11:44:10 -08:00
jetson-support.nix flake.nix: expose full scope in legacyPackages 2023-12-31 13:14:58 -08:00
nixpkgs-instances.nix nix: add a comment on the many nixpkgs-with-cuda instances 2024-01-22 12:19:30 +00:00
package.nix Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
scope.nix nix: init singularity and docker images (#5056) 2024-02-22 11:44:10 -08:00
sif.nix build(nix): Introduce flake.formatter for `nix fmt` (#5687) 2024-03-01 15:18:26 -08:00