Holo3 122B A10B
H Company · holo3-122b-a10b
- Latency
- 1.22 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.00024
- Attempts
- 1
{"has_issue":false,"category":null,"region":null,"description":": None"}
Layout defect scenario · 2026-08-13
Can vision models recognize the clean Flight pass UI?
Determine whether this clean control contains a visible layout defect.
Expected answerClean
390 × 844 · 9 model configurations
Exact input
Prompt
You are evaluating a user interface screenshot for objective rendering defects.
Check only for these visible issue categories: viewport_cropping, container_clipping, text_overflow, element_overlap, obscured_actionable_control, or broken_responsive_reflow. Do not report subjective design preferences, copywriting concerns, or accessibility assumptions.
If there is one visible issue, return its category and the tight affected region on a normalized 0 to 1000 grid. If none of these issues is visible, return has_issue=false and null category and region values.
Return only data matching the supplied JSON schema. Do not describe your reasoning.Ground truth
Model evidence
9 model results
Blue marks the seeded defect region. Orange marks the model’s returned region when available.
Correct
Grok 4.5
xAI · x-ai/grok-4.5- Latency
- 7.79 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0013
- Attempts
- 1
{"has_issue": false, "category": null, "region": null, "description": "No objective layout defects detected."}
GPT-5.4
OpenAI · openai/gpt-5.4- Latency
- 7.20 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0029
- Attempts
- 1
{"has_issue":false,"category":null,"region":null,"description":"No visible rendering defect in the specified categories."}
Gemini 3.6 Flash
Google AI Studio · google/gemini-3.6-flash- Latency
- 6.41 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0024
- Attempts
- 1
{"has_issue": false, "category": null, "region": null, "description": "The screenshot shows no visual rendering issues."}
GPT-5.6 Sol
OpenAI · openai/gpt-5.6-sol- Latency
- 7.86 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0055
- Attempts
- 1
{"has_issue":false,"category":null,"region":null,"description":"No visible rendering defect."}
GPT-5.6 Luna
OpenAI · openai/gpt-5.6-luna- Latency
- 4.32 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.00012
- Attempts
- 1
{"has_issue":false,"category":null,"region":null,"description":""}
Claude Sonnet 5
Anthropic · anthropic/claude-sonnet-5- Latency
- 10.54 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0030
- Attempts
- 1
{"has_issue":false,"category":null,"region":null,"description":"No visible layout defects detected."}
Claude Opus 5
Anthropic · anthropic/claude-opus-5- Latency
- 8.97 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0075
- Attempts
- 1
{"has_issue":false,"category":null,"region":null,"description":"No visible layout defects."}
Gemini 3.1 Pro Preview
Google AI Studio · google/gemini-3.1-pro-preview- Latency
- 10.48 s
- Category
- —
- Localization IoU
- —
- Cost
- $0.0027
- Attempts
- 1
{"has_issue": false, "category": null, "region": null, "description": "The UI looks fine"}