matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,634 Commits 3 Branches 4 Tags
7555ea44f81843a65d373e2bd20936adaea67c28
Commit Graph

2 Commits

Author SHA1 Message Date
Daniel Hiltgen
7555ea44f8 Revamp the dynamic library shim 
This switches the default llama.cpp to be CPU based, and builds the GPU variants
as dynamically loaded libraries which we can select at runtime.

This also bumps the ROCm library to version 6 given 5.7 builds don't work
on the latest ROCm library that just shipped.
 2023-12-20 14:45:57 -08:00
Daniel Hiltgen
35934b2e05 Adapted rocm support to cgo based llama.cpp 2023-12-19 09:05:46 -08:00