mirror of
https://github.com/dogkeeper886/ollama37.git
synced 2025-12-17 19:27:00 +00:00
enable metal gpu acceleration
ggml-metal.metal must be in the same directory as the ollama binary otherwise llama.cpp will not be able to find it and load it. 1. go generate llama/llama_metal.go 2. go build . 3. ./ollama serve
This commit is contained in:
committed by
Jeffrey Morgan
parent
b9fb988112
commit
1b7183c5a1
5
llama/llama_metal.go
Normal file
5
llama/llama_metal.go
Normal file
@@ -0,0 +1,5 @@
|
||||
//go:build metal
|
||||
package llama
|
||||
|
||||
//go:generate cmake -S . -B build --fresh -DLLAMA_METAL=on
|
||||
//go:generate cmake --build build
|
||||
Reference in New Issue
Block a user