matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3fe74fba42b8d496a1ab3e8298bdc9b8ffb0f336
ollama37/kvcache/causal.go
Jesse Gross 074bac8447 kvcache: Log batch size if we can't find a slot 
In some cases, we can't find a cache slot when using sliding window
attention. It would be helpful in this (and other cases) to know what
the batch size is.

Bug #10127
2025-05-01 16:26:36 -07:00

18 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink