matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-10 07:46:59 +00:00
Code Issues Packages Projects Releases Wiki Activity

update readme with docker setup and link to import.md

Browse Source
This commit is contained in:
Jeffrey Morgan
2023-10-15 02:23:03 -04:00
parent c416087339
commit f9b2f999ac
4 changed files with 38 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/import.md
View File

@@ -23,7 +23,7 @@ git clone https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1
cd Mistral-7B-Instruct-v0.1
```
### Step 2: Convert and quantize (PyTorch and Safetensors)
### Step 2: Convert and quantize (for PyTorch and Safetensors)
A [Docker image](https://hub.docker.com/r/ollama/quantize) with the tooling required to convert and quantize models is available.