matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-13 09:17:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3c75113e37cc2b5d9ad8cb5c21841437aab482cc
ollama37/server/sched_test.go
Daniel Hiltgen 3c75113e37 Prevent loading models larger than total memory 
Users may not realize the siny new model they're trying to load
fits on their disk, but can't load into system+GPU memory.  Today
we crash, but with this fix, we'll give them a better error message
before even trying to load it.
2024-07-03 14:47:42 -07:00

20 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink