matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-12 16:57:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
359b15a59785809465ddffbaffd8be0ae3afcd5a
ollama37/llm/memory.go
Daniel Hiltgen 359b15a597 Handle models with divergent layer sizes 
The recent refactoring of the memory prediction assumed all layers
are the same size, but for some models (like deepseek-coder-v2) this
is not the case, so our predictions were significantly off.
2024-06-18 11:05:34 -07:00

10 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink