matt/ollama37
1
0
Fork 0
mirror of https://github.com/dogkeeper886/ollama37.git synced 2025-12-11 16:26:59 +00:00
Code Issues Packages Projects Releases Wiki Activity

Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354)

Browse Source 
* read iogpu.wired_limit_mb on macOS

Fix for https://github.com/ollama/ollama/issues/1826

* improved determination of available vram on macOS

read the recommended maximal vram on macOS via Metal API

* Removed macOS-specific logging

* Remove logging from gpu_darwin.go

* release Core Foundation object

fixes a possible memory leak
This commit is contained in:
peanut256
2024-02-26 00:16:45 +01:00
committed by GitHub
parent e95b896790
commit a189810df6
3 changed files with 21 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
gpu/gpu_info_darwin.m Normal file
View File

@@ -0,0 +1,11 @@
//go:build darwin
#include "gpu_info_darwin.h"
uint64_t getRecommendedMaxVRAM()
{
id<MTLDevice> device = MTLCreateSystemDefaultDevice();
uint64_t result = device.recommendedMaxWorkingSetSize;
CFRelease(device);
return result;
}