mirror of
https://github.com/dogkeeper886/ollama37.git
synced 2025-12-10 15:57:04 +00:00
Add LD_LIBRARY_PATH to GitHub Actions workflows for CUDA library discovery
Set LD_LIBRARY_PATH in all workflow steps to ensure CUDA 11.4 libraries are found during both compile time and runtime. This fixes the issue where the GGML CUDA backend (libggml-cuda.so) fails to load when running 'ollama serve'. Library paths added: - /usr/local/cuda-11.4/lib64 - /usr/local/cuda-11.4/targets/x86_64-linux/lib - /usr/lib64 - /usr/local/lib64 Updated workflows: - tesla-k80-ci.yml: CMake configure, C++/CUDA build, Go build, binary verify - tesla-k80-single-gpu-tests.yml: All test execution steps - tesla-k80-multi-gpu-tests.yml: All test execution steps
This commit is contained in:
@@ -30,6 +30,8 @@ jobs:
|
||||
chmod +x ollama
|
||||
ls -lh ollama
|
||||
./ollama --version
|
||||
env:
|
||||
LD_LIBRARY_PATH: /usr/local/cuda-11.4/lib64:/usr/local/cuda-11.4/targets/x86_64-linux/lib:/usr/lib64:/usr/local/lib64
|
||||
|
||||
- name: Verify multi-GPU setup
|
||||
run: |
|
||||
@@ -49,15 +51,21 @@ jobs:
|
||||
go build -o ../../test-runner .
|
||||
cd ../..
|
||||
ls -lh test-runner
|
||||
env:
|
||||
LD_LIBRARY_PATH: /usr/local/cuda-11.4/lib64:/usr/local/cuda-11.4/targets/x86_64-linux/lib:/usr/lib64:/usr/local/lib64
|
||||
|
||||
- name: Validate multi-GPU test configuration
|
||||
run: |
|
||||
./test-runner validate --config test/config/models.yaml --profile multi-gpu
|
||||
env:
|
||||
LD_LIBRARY_PATH: /usr/local/cuda-11.4/lib64:/usr/local/cuda-11.4/targets/x86_64-linux/lib:/usr/lib64:/usr/local/lib64
|
||||
|
||||
- name: Run multi-GPU tests
|
||||
run: |
|
||||
./test-runner run --profile multi-gpu --config test/config/models.yaml --output test-report-multi-gpu --verbose
|
||||
timeout-minutes: 60
|
||||
env:
|
||||
LD_LIBRARY_PATH: /usr/local/cuda-11.4/lib64:/usr/local/cuda-11.4/targets/x86_64-linux/lib:/usr/lib64:/usr/local/lib64
|
||||
|
||||
- name: Check multi-GPU test results
|
||||
run: |
|
||||
|
||||
Reference in New Issue
Block a user