mirror of
https://github.com/dogkeeper886/ollama37.git
synced 2025-12-22 05:37:01 +00:00
Add comprehensive Ollama log checking and configurable LLM judge mode
Test case enhancements: - TC-RUNTIME-001: Add startup log error checking (CUDA, CUBLAS, CPU fallback) - TC-RUNTIME-002: Add GPU detection verification, CUDA init checks, error detection - TC-RUNTIME-003: Add server listening verification, runtime error checks - TC-INFERENCE-001: Add model loading logs, layer offload verification - TC-INFERENCE-002: Add inference error checking (CUBLAS/CUDA errors) - TC-INFERENCE-003: Add API request log verification, response time display Workflow enhancements: - Add judge_mode input (simple/llm/dual) to all workflows - Add judge_model input to specify LLM model for judging - Configurable via GitHub Actions UI without code changes 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
@@ -20,6 +20,30 @@ steps:
|
||||
- name: Check container status
|
||||
command: cd docker && docker compose ps
|
||||
|
||||
- name: Capture startup logs
|
||||
command: |
|
||||
cd docker && docker compose logs 2>&1 | head -100
|
||||
|
||||
- name: Check for startup errors in logs
|
||||
command: |
|
||||
cd docker
|
||||
LOGS=$(docker compose logs 2>&1)
|
||||
|
||||
# Check for critical errors
|
||||
if echo "$LOGS" | grep -qE "(level=ERROR|CUBLAS_STATUS_|CUDA error|cudaMalloc failed)"; then
|
||||
echo "CRITICAL ERRORS FOUND IN STARTUP LOGS:"
|
||||
echo "$LOGS" | grep -E "(level=ERROR|CUBLAS_STATUS_|CUDA error|cudaMalloc failed)"
|
||||
exit 1
|
||||
fi
|
||||
|
||||
# Check for CPU-only fallback (GPU not detected)
|
||||
if echo "$LOGS" | grep -q "id=cpu library=cpu"; then
|
||||
echo "ERROR: Ollama fell back to CPU-only mode"
|
||||
exit 1
|
||||
fi
|
||||
|
||||
echo "SUCCESS: No critical errors in startup logs"
|
||||
|
||||
criteria: |
|
||||
The ollama37 container should start successfully with GPU access.
|
||||
|
||||
@@ -27,5 +51,7 @@ criteria: |
|
||||
- Container starts without errors
|
||||
- docker compose ps shows container in "Up" state
|
||||
- No "Exited" or "Restarting" status
|
||||
- No critical errors in logs (level=ERROR, CUBLAS_STATUS_, CUDA error)
|
||||
- No CPU-only fallback (id=cpu library=cpu)
|
||||
|
||||
Accept startup warnings. Container should be running.
|
||||
Accept startup warnings (flash attention not supported is OK). Container should be running.
|
||||
|
||||
Reference in New Issue
Block a user