matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 00:07:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
074bac844714b3a011d1cf6ebc40c169b10d1aef
ollama37/kvcache/causal.go
Jesse Gross 074bac8447 kvcache: Log batch size if we can't find a slot 
In some cases, we can't find a cache slot when using sliding window
attention. It would be helpful in this (and other cases) to know what
the batch size is.

Bug #10127
2025-05-01 16:26:36 -07:00

18 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink