3 Commits

Author	SHA1	Message	Date
slaren	1e909c9209	Improve cuBLAS performance by using a memory pool (#1094) ... * Improve cuBLAS performance by using a memory pool * Move cuda specific definitions to ggml-cuda.h/cu * Add CXX flags to nvcc * Change memory pool synchronization mechanism to a spin lock General code cleanup	2023-04-21 21:59:17 +02:00
slaren	dc2fb22941	Add Q4_3 support to cuBLAS (#1086)	2023-04-20 20:49:53 +02:00
slaren	881ecfb4ef	Improve cuBLAS performance by dequantizing on the GPU (#1065)	2023-04-20 03:14:14 +02:00