ollama37/llm/ggml.go at 021817e59ace5e351b35b2e6881f83a09f038546 - ollama37 - Gitea: Git with a cup of tea

matt/ollama37

mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00

Files

Sam 1bdab9fdb1 llm: introduce k/v context quantization (vRAM improvements) (#6279 )

2024-12-03 15:57:19 -08:00

14 KiB

Raw Blame History

View Raw