This website requires JavaScript.
Explore
Help
Sign In
nicolas
/
ik_llama_opt
Watch
1
Star
0
Fork
You've already forked ik_llama_opt
0
Code
Issues
Pull Requests
Packages
Projects
Releases
Wiki
Activity
617732791e
ik_llama_opt
/
github-data
/
discussions
History
Thomas
eaa2510a28
Add GitHub data: filename sanitization (
#640
)
2025-07-23 13:31:53 +02:00
..
8 - New quantization types IQ2_K_ IQ3_K_ IQ4_K_ IQ5_K.md
…
15 - Will LQER improve k- and i-quants_.md
…
18 - CPU beating GPU in token generation speed.md
…
25 - CPU prompt processing speed for large contexts.md
…
63 - LLaMA-3.2 quantization evaluation.md
…
82 - 4bpw GGML TYPE_.md
…
95 - Bitnet.md
…
100 - New argument _ env variable for GGML_SCHED_MAX_COPIES_.md
…
104 - Convenience improvements for llama-quantize.md
…
140 - Questions about weight_j_.md
…
164 - Latest CPU performance comparison with llama.cpp.md
…
165 - Norm RMS Epsilon.md
…
166 - Learning more LLM quantization.md
…
201 - What is the NUMA situation _.md
…
211 - help me create an importance matrix primer.md
…
223 - Recent performance testing with DeepSeek R1.md
…
242 - Switching from llama.cpp_ktransformers_ seeking advice_guidance.md
…
256 - Diverging from llama.cpp.md
…
258 - Quick-start Guide coming over from llama.cpp and ktransformers_.md
…
266 - Benchmarking DeepSeek R1 - 16x3090.md
…
286 - Testing _deepseek-ai_DeepSeek-V3-0324_ model support..md
…
288 - On _compilade_s PR 12557 and _jukofyork_s quantization ideas.md
…
316 - Mainline is now copying stuff from ik_llama.cpp.md
…
319 - KTransformers copying ik_llama.cpp.md
…
323 - Is there an easy way to repack an existing GGUF so it could be used wit.md
…
334 - _iq4_ks_ performs great on gemma-3-27b-it-qat-q4_0-unquantized.md
…
350 - Maverick slow prompt with gpu.md
…
354 - Not all MLAs are born equal.md
…
357 - Qwen3 - early performance comparisons.md
…
359 - Qwen3 quantization experiments.md
…
372 - multy gpu.md
…
384 - ik_llama.cpp issues on an old workstation.md
…
385 - Qwen3 235B performance on Intel Xeon Scalable processor.md
…
393 - Creating quantized models.md
…
395 - Why does imatrix not tokenize special tokens_.md
…
396 - Best settings for Maverick - Dual CPU Xeon 8480_ - RTX 3090.md
…
397 - KV split while using _-sm row_.md
…
399 - Qwen 30b.A3b IK_LCPP comparisons on lowspec machine.md
…
401 - install bitnet _or other cpu models_ on a fresh termux aarch64.md
…
403 - Tool Calling and Structured Response _Json Mode_ support.md
…
434 - Quant Cookers Basic Guide.md
Add GitHub data: filename sanitization (
#640
)
2025-07-23 13:31:53 +02:00
451 - Context reuse _ context shift for long prompts.md
…
459 - qwen3 metrics on ancient hardware _2x xeon Vs 2x P100_.md
…
466 - A curiosity..md
Add GitHub data: filename sanitization (
#640
)
2025-07-23 13:31:53 +02:00
477 - DeepSeek-R1-0528 ik quants_.md
…
491 - -rtr actually hurts prompt t_s for large ubatch_.md
…
519 - Android Build.md
…
526 - Partial requant feature to save compute and time during tests..md
…
532 - Guidance on GPU Layer Offloading Strategy in ik_llama.cpp for Multi GPU.md
…
543 - dots.llm1 support and thanks.md
…
545 - Vulkan support_.md
…
548 - Poor performance with bf16 model on Qwen3 30B-A3B.md
…
556 - ik_llama.cpp for Armv8.0.md
…
562 - AMD GPU Vulkan _ ROCm_HIP Discussion.md
…
564 - Maybe an interesting CUDA PR here..md
…
586 - Slow KV cache rm operation.md
…
590 - How important is Vulkan back-end development_.md
…
591 - I dont see any speed improvement in generation_ so want to understand i.md
…
594 - Is AVX2 a hard requirement on x64_.md
…
599 - mla matrix absorbtion.md
…
613 - Pathological Quant_CUDA combinations -- How to know what works_.md
…
619 - gpu p2p utilization.md
…
621 - Deepseek v3_r1 poisoned prompt_.md
…
623 - Quantizing panels_bundles instead of blocks_.md
…
Powered by
TurnKey Linux
.