matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 16:26:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
033cec232a7e6702d6a79ca22ca81200fad5873b
ollama37/kvcache/causal.go
Jesse Gross a8e83a7654 Disable causal attention based on batch index 
Currently we are using positions, which are relative to a
sequence and may not be unique.
2025-03-11 14:49:20 -07:00

15 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink