mirror of
https://github.com/dogkeeper886/ollama37.git
synced 2025-12-21 21:26:59 +00:00
ebcca9f483
Tesla K80 needs ~60-180s to load model into VRAM on first inference. Add warmup step with 5-minute timeout to preload model before subsequent inference tests run. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
41 lines
1.2 KiB
YAML
41 lines
1.2 KiB
YAML
id: TC-INFERENCE-001
|
|
name: Model Pull
|
|
suite: inference
|
|
priority: 1
|
|
timeout: 600000
|
|
|
|
dependencies:
|
|
- TC-RUNTIME-003
|
|
|
|
steps:
|
|
- name: Check if model exists
|
|
command: docker exec ollama37 ollama list | grep -q "gemma3:4b" && echo "Model exists" || echo "Model not found"
|
|
|
|
- name: Pull model if needed
|
|
command: docker exec ollama37 ollama list | grep -q "gemma3:4b" || docker exec ollama37 ollama pull gemma3:4b
|
|
timeout: 600000
|
|
|
|
- name: Verify model available
|
|
command: docker exec ollama37 ollama list
|
|
|
|
- name: Warmup model (preload into GPU)
|
|
command: |
|
|
curl -s http://localhost:11434/api/generate \
|
|
-d '{"model":"gemma3:4b","prompt":"hi","stream":false}' \
|
|
| jq -r '.response' | head -c 100
|
|
timeout: 300000
|
|
|
|
criteria: |
|
|
The gemma3:4b model should be available for inference.
|
|
|
|
Expected:
|
|
- Model is either already present or successfully downloaded
|
|
- "ollama list" shows gemma3:4b in the output
|
|
- No download errors
|
|
- Warmup step loads model into GPU memory (may take up to 3 minutes on Tesla K80)
|
|
- Warmup returns a response from the model
|
|
|
|
Accept if model already exists (skip download).
|
|
Model size is ~3GB, download may take time.
|
|
First inference loads model into VRAM - subsequent inferences will be fast.
|