matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-19 04:07:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6da8b6a87902c8cf875028329ade512c8d859059
ollama37/kvcache/causal.go
Jesse Gross 6da8b6a879 kvcache: Support non-causal attention 
Models can disable causality for all or part of their processing
while continuing to store data in the KV cache.
2025-03-07 18:39:27 -08:00

15 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink