Layout defect scenario · 2026-08-13

Detect container clipping in Commerce catalog

Identify the single seeded visible layout defect.

Expected answercontainer clipping

1440 × 900 · 9 model configurations

Exact input

Prompt

You are evaluating a user interface screenshot for objective rendering defects.

Check only for these visible issue categories: viewport_cropping, container_clipping, text_overflow, element_overlap, obscured_actionable_control, or broken_responsive_reflow. Do not report subjective design preferences, copywriting concerns, or accessibility assumptions.

If there is one visible issue, return its category and the tight affected region on a normalized 0 to 1000 grid. If none of these issues is visible, return has_issue=false and null category and region values.

Return only data matching the supplied JSON schema. Do not describe your reasoning.
SHA-256 · 7d8cfe281f4ef9b625bbcc6c89c45236b392624e96c23044e6dcaac1d8d7adb0

Ground truth

Commerce catalog layout-defect benchmark screenshotExpected defect
Ground truth: container clipping

Model evidence

9 model results

Blue marks the seeded defect region. Orange marks the model’s returned region when available.

Holo3 122B A10B

H Company · holo3-122b-a10b
Incorrect
Latency
4.55 s
Category
Localization IoU
0.000
Cost
$0.0018
Attempts
1
                  {"has_issue":true,"category":"text_overflow","region":{"x":192,"y":160,"width":100,"height":5000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
                

SyntaxError

Grok 4.5

xAI · x-ai/grok-4.5
Correct
Latency
8.63 s
Category
viewport cropping
Localization IoU
0.000
Cost
$0.0041
Attempts
1
                  {"has_issue": true, "category": "viewport_cropping", "region": {"x": 220, "y": 95, "width": 280, "height": 70}, "description": "Page title text is cropped on the left, showing only partial words 'ANAGEMENT' and 'ducts'."}
                

GPT-5.4

OpenAI · openai/gpt-5.4
Correct
Latency
9.24 s
Category
container clipping
Localization IoU
0.414
Cost
$0.0068
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":193,"y":98,"width":171,"height":90},"description":"The page title text is clipped on the left, showing only the trailing portion ('ducts') instead of the full word."}
                

Gemini 3.6 Flash

Google AI Studio · google/gemini-3.6-flash
Correct
Latency
9.66 s
Category
container clipping
Localization IoU
0.206
Cost
$0.0043
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":192,"y":127,"width":68,"height":67},"description":"The section title 'MANAGEMENT Products' is clipped on the left edge, showing only 'IANAGEMENT ducts'."}
                

GPT-5.6 Sol

OpenAI · openai/gpt-5.6-sol
Correct
Latency
15.88 s
Category
container clipping
Localization IoU
0.213
Cost
$0.0183
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":192,"y":124,"width":71,"height":67},"description":"The page heading and eyebrow text are clipped along their left edge."}
                

GPT-5.6 Luna

OpenAI · openai/gpt-5.6-luna
Correct
Latency
9.78 s
Category
container clipping
Localization IoU
0.132
Cost
$0.00035
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":192,"y":148,"width":71,"height":41},"description":"The page heading is visibly clipped on the left, rendering only “ducts” instead of the full “Products”."}
                

Claude Sonnet 5

Anthropic · anthropic/claude-sonnet-5
Correct
Latency
11.34 s
Category
container clipping
Localization IoU
0.225
Cost
$0.0062
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":278,"y":105,"width":400,"height":60},"description":"The page title 'Product Management' is clipped on the left, showing only 'ducts' and 'IANAGEMENT' instead of full text."}
                

Claude Opus 5

Anthropic · anthropic/claude-opus-5
Correct
Latency
11.46 s
Category
container clipping
Localization IoU
0.169
Cost
$0.0159
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":186,"y":120,"width":72,"height":63},"description":"The page heading \"Products\" and its eyebrow label \"MANAGEMENT\" are clipped on the left edge, rendering as \"ducts\" / \"IANAGEMENT\"."}
                

Gemini 3.1 Pro Preview

Google AI Studio · google/gemini-3.1-pro-preview
Correct
Latency
24.13 s
Category
container clipping
Localization IoU
0.212
Cost
$0.0032
Attempts
1
                  {"has_issue":true,"category":"container_clipping","region":{"x":192,"y":126,"width":70,"height":67},"description":"The text 'ducts' and 'IANAGEMENT' is cut off on the left side."}
                
EN