ollama37/llm/ggml.go at 9a4757ae6690605298fda69c2cc1909a60508d1f - ollama37 - Gitea: Git with a cup of tea

matt/ollama37

mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-17 11:17:11 +00:00

Files

Sam 1bdab9fdb1 llm: introduce k/v context quantization (vRAM improvements) (#6279 )

2024-12-03 15:57:19 -08:00

14 KiB

Raw Blame History

View Raw