Merge pull request #1146 from dhiltgen/ext_server_cgo

Add cgo implementation for llama.cpp
This commit is contained in:
Daniel Hiltgen
2023-12-22 08:16:31 -08:00
committed by GitHub
55 changed files with 3207 additions and 1181 deletions

View File

@@ -192,13 +192,19 @@ Install `cmake` and `go`:
brew install cmake go
```
Then generate dependencies and build:
Then generate dependencies:
```
go generate ./...
```
Then build the binary:
```
go build .
```
More detailed instructions can be found in the [developer guide](https://github.com/jmorganca/ollama/blob/main/docs/development.md)
### Running local builds
Next, start the server:
```