add llama.cpp go bindings

This commit is contained in:
Jeffrey Morgan
2023-07-03 16:32:48 -04:00
parent 76cb60d496
commit 6093a88c1a
18 changed files with 841 additions and 79 deletions

View File

@@ -1,6 +1,6 @@
# Ollama
A fast runtime for large language models, powered by [llama.cpp](https://github.com/ggerganov/llama.cpp).
An easy, fast runtime for large language models, powered by `llama.cpp`.
> _Note: this project is a work in progress. Certain models that can be run with `ollama` are intended for research and/or non-commercial use only._
@@ -38,6 +38,13 @@ Or directly via downloaded model files:
ollama run ~/Downloads/orca-mini-13b.ggmlv3.q4_0.bin
```
## Building
```
go generate ./...
go build .
```
## Documentation
- [Development](docs/development.md)