mirror of
https://github.com/dogkeeper886/ollama37.git
synced 2025-12-10 07:46:59 +00:00
Server
🙊
Installation
If using Apple silicon, you need a Python version that supports arm64:
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh
Get the dependencies:
pip install -r requirements.txt
Building
python3 build.py
Running
Put your model in models/ and run:
python server.py
API
POST /generate
model: string - The name of the model to use in the models folder.
prompt: string - The prompt to use.