Layout defect scenario · 2026-08-13

Detect element overlap in IoT control center

Identify the single seeded visible layout defect.

Expected answerelement overlap

1440 × 900 · 9 model configurations

Exact input

Prompt

You are evaluating a user interface screenshot for objective rendering defects.

Check only for these visible issue categories: viewport_cropping, container_clipping, text_overflow, element_overlap, obscured_actionable_control, or broken_responsive_reflow. Do not report subjective design preferences, copywriting concerns, or accessibility assumptions.

If there is one visible issue, return its category and the tight affected region on a normalized 0 to 1000 grid. If none of these issues is visible, return has_issue=false and null category and region values.

Return only data matching the supplied JSON schema. Do not describe your reasoning.
SHA-256 · 7d8cfe281f4ef9b625bbcc6c89c45236b392624e96c23044e6dcaac1d8d7adb0

Ground truth

IoT control center layout-defect benchmark screenshotExpected defect
Ground truth: element overlap

Model evidence

9 model results

Blue marks the seeded defect region. Orange marks the model’s returned region when available.

Holo3 122B A10B

H Company · holo3-122b-a10b
Incorrect
Latency
4.42 s
Category
Localization IoU
0.000
Cost
$0.0018
Attempts
1
                  {"has_issue":true,"category":"obscured_actionable_control","region":{"x":462,"y":558,"width":284,"height":62.559997558593750000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
                

SyntaxError

Grok 4.5

xAI · x-ai/grok-4.5
Correct
Latency
8.66 s
Category
element overlap
Localization IoU
0.074
Cost
$0.0041
Attempts
1
                  {"has_issue": true, "category": "element_overlap", "region": {"x": 420, "y": 520, "width": 200, "height": 70}, "description": "Red 'Maintenance scheduled' badge overlaps and covers the middle of the device list table rows."}
                

GPT-5.4

OpenAI · openai/gpt-5.4
Correct
Latency
9.93 s
Category
element overlap
Localization IoU
0.078
Cost
$0.0073
Attempts
1
                  {"has_issue":true,"category":"element_overlap","region":{"x":462,"y":558,"width":223,"height":66},"description":"A notification banner overlaps the table content in the device list."}
                

Gemini 3.6 Flash

Google AI Studio · google/gemini-3.6-flash
Correct
Latency
9.32 s
Category
element overlap
Localization IoU
0.078
Cost
$0.0032
Attempts
1
                  {"has_issue":true,"category":"element_overlap","region":{"x":462,"y":557,"width":223,"height":66},"description":"The 'Maintenance scheduled' overlay badge overlaps and obscures table content in the list below."}
                

GPT-5.6 Sol

OpenAI · openai/gpt-5.6-sol
Correct
Latency
9.01 s
Category
element overlap
Localization IoU
0.078
Cost
$0.0153
Attempts
1
                  {"has_issue":true,"category":"element_overlap","region":{"x":463,"y":558,"width":222,"height":66},"description":"A maintenance notification overlays the device table rows."}
                

GPT-5.6 Luna

OpenAI · openai/gpt-5.6-luna
Incorrect
Latency
9.56 s
Category
Localization IoU
0.000
Cost
$0.00036
Attempts
1
                  {"has_issue":false,"category":null,"region":null,"description":""}
                

Claude Sonnet 5

Anthropic · anthropic/claude-sonnet-5
Correct
Latency
10.76 s
Category
element overlap
Localization IoU
0.071
Cost
$0.0062
Attempts
1
                  {"has_issue":true,"category":"element_overlap","region":{"x":665,"y":505,"width":320,"height":55},"description":"A red 'Maintenance scheduled' tooltip/banner overlaps the device rows, covering part of the Cooling pump and Intake valve entries."}
                

Claude Opus 5

Anthropic · anthropic/claude-opus-5
Correct
Latency
8.62 s
Category
element overlap
Localization IoU
0.081
Cost
$0.0155
Attempts
1
                  {"has_issue":true,"category":"element_overlap","region":{"x":461,"y":561,"width":225,"height":68},"description":"The red \"Maintenance scheduled\" banner floats over the device table rows, overlapping the Cooling pump and Intake valve rows."}
                

Gemini 3.1 Pro Preview

Google AI Studio · google/gemini-3.1-pro-preview
Correct
Latency
37.14 s
Category
element overlap
Localization IoU
0.077
Cost
$0.0032
Attempts
1
                  {"has_issue": true, "category": "element_overlap", "region": {"x": 462, "y": 557, "width": 223, "height": 65}, "description": "The 'Maintenance scheduled' modal overlays the device list."}
                
EN