matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-17 11:17:11 +00:00
Code Issues Packages Projects Releases Wiki Activity

Revert "Allow models to force a new batch"

Browse Source 
This reverts commit c7eae586b899083acebcd9b3847b89ea78c2850c.
This commit is contained in:
jmorganca
2025-03-11 11:53:37 +01:00
committed by Michael Yang
parent 06007c0a18
commit 65b0f329d1
4 changed files with 14 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
model/input/input.go
View File

@@ -15,12 +15,6 @@ type Input struct {
// stored in Multimodal, used for caching and comparing
// equality.
MultimodalHash uint64
// BatchBreak forces a new batch to be started with this
// input. For example, this can be used to align images
// with batches. Note that batches may be divided in additional
// locations as well.
BatchBreak bool
}
// MultimodalIndex is a multimodal element (such as an image)