Devon Rifkin 6ed8898590 ggml: fix crash for array head counts ...

If it's an array, it uses the max value in the array

If array values for head counts becomes more popular, we can consider a
more invasive change like #10225 to calculate more accurate estimates.

Fixes: #9984

2025-04-27 11:38:06 -07:00

..

llm_darwin.go

Optimize container images for startup (#6547)

2024-09-12 12:10:30 -07:00

llm_linux.go

Optimize container images for startup (#6547)

2024-09-12 12:10:30 -07:00

llm_windows.go

runner: Set windows above normal priority (#6905)

2024-09-21 16:54:49 -07:00

memory_test.go

ggml: Support heterogeneous KV cache layer sizes in memory estimation

2025-03-26 13:16:03 -07:00

memory.go

ggml: fix crash for array head counts

2025-04-27 11:38:06 -07:00

server_test.go

llm: do not error on "null" format (#8139)

2024-12-17 09:49:37 -08:00

server.go

server: improve spacing for JSON grammar (#10131)

2025-04-24 16:47:57 -07:00

status.go

Improve crash reporting (#7728)

2024-11-19 16:26:57 -08:00