Add KV Cache mixed-precision quantization with ggml-level Q8_0 optimization#5

Draft

Copilot wants to merge 19 commits intomasterfrom

copilot/optimize-kv-cache-performance

Commits on Jan 13, 2026

Initial plan
Copilot
committed
Add KV Cache Q8_0 quantization support for reduced memory usage

Copilot
and
lhpqaq
committed
Improve KV cache Q8_0 documentation and help text clarity

Copilot
and
lhpqaq
committed
Revert Q8_0 KV cache code changes; document block alignment issue and mixed precision strategies

Copilot
and
lhpqaq
committed
Add practical KV cache optimization strategies section with implementation guidance

Copilot
and
lhpqaq
committed
Implement separate K/V cache type configuration for mixed precision

Copilot
and
lhpqaq
committed

Commits on Jan 14, 2026