Michael Yang bab6f34dc0 ml/backend/ggml: update model loading for hybrid/multi backends ...

use a similar strategy as llama.cpp for deciding where tensors should be
allocated. this will be improved later to be aware of usable memory
before assigning the tensor

2025-03-07 14:08:21 -08:00

20 KiB

Raw Blame History

View Raw