matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
7b68e254c29bea48dec9a455a5a46b4ac6c823c2
ollama37/runner/ollamarunner
History
Jesse Gross a27462b708 ollamarunner: Temporarily disable worst case graph preallocation 
When we later have a large batch running purely on a CPU, this
results the error:
GGML_ASSERT(talloc->buffer_id >= 0)

Disabling this means that we will incrementally reallocate memory
as the graph grows.

Fixes #10410
2025-04-29 11:04:58 -07:00
..
cache_test.go
ollamarunner: Preallocate worst case graph at startup
2025-04-08 10:01:28 -07:00
cache.go
kvcache: Add check for values that fall out of sliding window cache
2025-04-02 11:55:48 -07:00
runner.go
ollamarunner: Temporarily disable worst case graph preallocation
2025-04-29 11:04:58 -07:00