4 Commits

Author	SHA1	Message	Date
Kawrakow	318899c8b7	bitnet: add 2 bpw quantization ... The scalar dot product already chieves 37 t/s for TG!	2024-06-22 12:02:51 +03:00
Kawrakow	f9ba085ef7	Move Q8_K64 quantization to iqk-quantize.cpp and add copyright notice	2024-06-22 12:02:51 +03:00
Kawrakow	b0967ffa79	bitnet: fix scalar dot product ... I had forgotten to adjust for the change to q8_K64. On the M2 I'm getting 10.8 t/s with the scalar version!	2024-06-22 12:02:51 +03:00
Kawrakow	81576cdcac	bitnet: python + llama	2024-06-22 12:02:51 +03:00