5 Commits

Author	SHA1	Message	Date
Michael Yang	1b7183c5a1	enable metal gpu acceleration ... ggml-metal.metal must be in the same directory as the ollama binary otherwise llama.cpp will not be able to find it and load it. 1. go generate llama/llama_metal.go 2. go build . 3. ./ollama serve	2023-07-06 16:34:44 -04:00
Jeffrey Morgan	79a999e95d	fix crash in bindings	2023-07-06 16:34:44 -04:00
Jeffrey Morgan	0240165388	fix llama.cpp build	2023-07-06 16:34:44 -04:00
Jeffrey Morgan	9164981d72	move prompt templates out of python bindings	2023-07-06 16:34:44 -04:00
Jeffrey Morgan	6093a88c1a	add llama.cpp go bindings	2023-07-06 16:34:44 -04:00