matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 00:07:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a50a87a7b87edc9529c9b235f33b37a7cfa30daa
ollama37/llm/server.go
Jeffrey Morgan a50a87a7b8 partial offloading: allow flash attention and disable mmap (#4734) 
* partial offloading: allow flash attention and disable mmap

* allow mmap with num_gpu=0
2024-05-30 16:58:01 -07:00

26 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink