matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-12 00:37:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
0478d440f0ba62202bc4b98043ae4a7d0b85e4ba
ollama37/server/create.go
Bruce MacDonald ad035ad595 convert: quantize from safetensors needs kv (#10675) 
When creating a quantized model from safetensors we
need the array KV values to be loaded.Changing this
value to -1 loads the KV values on the returned
layer to be used and saved during quantization.
2025-05-12 12:04:20 -07:00

18 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink