Add model warmup step to TC-INFERENCE-001

Tesla K80 needs ~60-180s to load model into VRAM on first inference.
Add warmup step with 5-minute timeout to preload model before
subsequent inference tests run.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
Shang Chieh Tseng
2025-12-15 21:38:09 +08:00
parent 3f3f68f08d
commit ebcca9f483

View File

@@ -18,6 +18,13 @@ steps:
- name: Verify model available
command: docker exec ollama37 ollama list
- name: Warmup model (preload into GPU)
command: |
curl -s http://localhost:11434/api/generate \
-d '{"model":"gemma3:4b","prompt":"hi","stream":false}' \
| jq -r '.response' | head -c 100
timeout: 300000
criteria: |
The gemma3:4b model should be available for inference.
@@ -25,6 +32,9 @@ criteria: |
- Model is either already present or successfully downloaded
- "ollama list" shows gemma3:4b in the output
- No download errors
- Warmup step loads model into GPU memory (may take up to 3 minutes on Tesla K80)
- Warmup returns a response from the model
Accept if model already exists (skip download).
Model size is ~3GB, download may take time.
First inference loads model into VRAM - subsequent inferences will be fast.