Holo3 122B A10B
H Company · holo3-122b-a10b
- Latency
- 1.11 s
- Cost
- $0.00017
- Attempts
- 1
{"found":true}
Element presence scenario · 2026-08-13
Is the Add device button present in Smart home?
Determine whether the Add device button is visibly present.
Expected answerPresent
390 × 844 · 9 model configurations
Exact input
Prompt
You are evaluating a user interface screenshot for test automation.
Determine whether the single UI element described below is visibly present. Return found=true if it is present and found=false if it is absent.
Target: the Add device button
Return only data matching the supplied JSON schema. Do not describe your reasoning.
This dated pilot used the geometry-capable prompt shown above. The published presence result uses only the returned found value; geometry is neither scored nor displayed.
Ground truth
Model evidence
9 model results
Presence pages report only the boolean classification. Original model output remains visible for auditability.
Correct
Grok 4.5
xAI · x-ai/grok-4.5- Latency
- 7.82 s
- Cost
- $0.0013
- Attempts
- 1
{"found": true}
GPT-5.4
OpenAI · openai/gpt-5.4- Latency
- 8.33 s
- Cost
- $0.0016
- Attempts
- 1
{"found":true}
Gemini 3.6 Flash
Google AI Studio · google/gemini-3.6-flash- Latency
- 8.83 s
- Cost
- $0.0022
- Attempts
- 1
{"found":true}
GPT-5.6 Sol
OpenAI · openai/gpt-5.6-sol- Latency
- 8.18 s
- Cost
- $0.0032
- Attempts
- 1
{"found":true}
GPT-5.6 Luna
OpenAI · openai/gpt-5.6-luna- Latency
- 8.28 s
- Cost
- $0.00006
- Attempts
- 1
{"found":true}
Claude Sonnet 5
Anthropic · anthropic/claude-sonnet-5- Latency
- 8.79 s
- Cost
- $0.0017
- Attempts
- 1
{"found":true}
Claude Opus 5
Anthropic · anthropic/claude-opus-5- Latency
- 9.52 s
- Cost
- $0.0043
- Attempts
- 1
{"found": true}
Gemini 3.1 Pro Preview
Google AI Studio · google/gemini-3.1-pro-preview- Latency
- 15.90 s
- Cost
- $0.0023
- Attempts
- 1
{"found": true}