matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-12 16:57:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
764e199d6703d80da4d245381efa4a3a412813b2
ollama37/ml/backend.go
Michael Yang 764e199d67 kvcache: create cache ctx per layer 
each cache layer creates and maintains its own context instead of using
a large context for all layers
2025-03-07 14:08:21 -08:00

7.1 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink