Michael Yang 9685c34509 quantize any fp16/fp32 model ...

- FROM /path/to/{safetensors,pytorch}
- FROM /path/to/fp{16,32}.bin
- FROM model:fp{16,32}

2024-05-06 15:24:01 -07:00

32 KiB

Raw Blame History

View Raw