matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-10 15:57:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
4d4463b2bd5443adc5e86943132ee727550f09b7
ollama37/ml/backend.go
Jesse Gross 4d4463b2bd backend: Support graph computation that does not return an output 
There are two cases where we may not have an output after computing:
 - Prompt processing where the length of the input exceeds the batch
   size
 - Internal memory management operations such as cache defrag and shift
2025-02-13 17:09:26 -08:00

4.3 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink