matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 08:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bd6a7d5e6416c4c2aeba07233303385254395b6c
ollama37/ml/backend/ggml
History
Jesse Gross bd6a7d5e64 ollamarunner: Pass runner performance parameters to backends 
Currently the following parameters are in the runner but not used:
 - numGPULayers
 - mainGPU
 - threads
 - tensorSplit

This passes them through to the backend, which is where they would
actually get used. However, the GGML backend does not yet do anything
with them.
2025-02-20 13:27:57 -08:00
..
ggml
Merge pull request #9203 from ollama/mxyng/sapphirerapids
2025-02-19 21:42:00 +00:00
ggml.go
ollamarunner: Pass runner performance parameters to backends
2025-02-20 13:27:57 -08:00