Holo3 122B A10B
H Company · holo3-122b-a10b
- Latency
- 1.11 s
- Cost
- $0.00017
- Attempts
- 1
{"found":false}
Element presence scenario · 2026-08-13
Is the Unlock front door button present in Smart home?
Determine whether the Unlock front door button is visibly present.
Expected answerAbsent
390 × 844 · 9 model configurations
Exact input
Prompt
You are evaluating a user interface screenshot for test automation.
Determine whether the single UI element described below is visibly present. Return found=true if it is present and found=false if it is absent.
Target: the Unlock front door button
Return only data matching the supplied JSON schema. Do not describe your reasoning.
This dated pilot used the geometry-capable prompt shown above. The published presence result uses only the returned found value; geometry is neither scored nor displayed.
Ground truth
Model evidence
9 model results
Presence pages report only the boolean classification. Original model output remains visible for auditability.
Correct
Grok 4.5
xAI · x-ai/grok-4.5- Latency
- 7.99 s
- Cost
- $0.0013
- Attempts
- 1
{"found": false}
GPT-5.4
OpenAI · openai/gpt-5.4- Latency
- 7.91 s
- Cost
- $0.0021
- Attempts
- 1
{"found":false}
Gemini 3.6 Flash
Google AI Studio · google/gemini-3.6-flash- Latency
- 8.69 s
- Cost
- $0.0026
- Attempts
- 1
{"found": false}
GPT-5.6 Sol
OpenAI · openai/gpt-5.6-sol- Latency
- 8.85 s
- Cost
- $0.0032
- Attempts
- 1
{"found":false}
GPT-5.6 Luna
OpenAI · openai/gpt-5.6-luna- Latency
- 8.26 s
- Cost
- $0.00006
- Attempts
- 1
{"found":false}
Claude Sonnet 5
Anthropic · anthropic/claude-sonnet-5- Latency
- 8.85 s
- Cost
- $0.0017
- Attempts
- 1
{"found": false}
Claude Opus 5
Anthropic · anthropic/claude-opus-5- Latency
- 12.07 s
- Cost
- $0.0043
- Attempts
- 1
{"found":false}
Gemini 3.1 Pro Preview
Google AI Studio · google/gemini-3.1-pro-preview- Latency
- 12.13 s
- Cost
- $0.0023
- Attempts
- 1
{"found": true}