matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

first pass at linux gpu support (#454)

Browse Source 
* linux gpu support
* handle multiple gpus
* add cuda docker image (#488)
---------

Co-authored-by: Michael Yang <mxyng@pm.me>
This commit is contained in:
Bruce MacDonald
2023-09-12 11:04:35 -04:00
committed by GitHub
parent 45ac07cd02
commit f221637053
9 changed files with 158 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
docs/development.md
View File

@@ -6,6 +6,10 @@
Install required tools:
- cmake version 3.24 or higher
- go version 1.20 or higher
- gcc version 11.4.0 or higher
```
brew install go cmake gcc
```
@@ -27,3 +31,9 @@ Now you can run `ollama`:
```
./ollama
```
## Building on Linux with GPU support
- Install cmake and nvidia-cuda-toolkit
- run `go generate ./...`
- run `go build .`