matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
5b806d8d24be6c345318ccaa20d6d36b88648e80
ollama37/server/sched_test.go
Daniel Hiltgen d6e3b64582 Fix concurrency for CPU mode 
Prior refactoring passes accidentally removed the logic to bypass VRAM
checks for CPU loads.  This adds that back, along with test coverage.

This also fixes loaded map access in the unit test to be behind the mutex which was
likely the cause of various flakes in the tests.
2024-04-28 13:42:39 -07:00

18 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink