Jesse Gross 4d4463b2bd backend: Support graph computation that does not return an output ...

There are two cases where we may not have an output after computing:
 - Prompt processing where the length of the input exceeds the batch
   size
 - Internal memory management operations such as cache defrag and shift

2025-02-13 17:09:26 -08:00

..

backend

backend: Support graph computation that does not return an output

2025-02-13 17:09:26 -08:00

nn

next ollama runner (#7913)

2025-02-13 16:31:21 -08:00

backend.go

backend: Support graph computation that does not return an output

2025-02-13 17:09:26 -08:00