rendercheck test always fail

Bug #1093718 reported by Jeffrey Chang
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Checkbox
Fix Released
Medium
Brendan Donegan

Bug Description

According to https://code.launchpad.net/~albertomilone/checkbox/rendercheck_test/+merge/120608/comments/260713,
rendercheck test was guaranteed to fail.

We saw identical fail result on multiple systems.
And this also affect stress/graphics test, cause rendertest was part of that.

Related branches

Revision history for this message
Brendan Donegan (brendan-donegan) wrote :

We need a wrapper script for this similar to the one for piglit

Changed in checkbox:
status: New → Triaged
importance: Undecided → Medium
assignee: nobody → Brendan Donegan (brendan-donegan)
status: Triaged → In Progress
Revision history for this message
Brendan Donegan (brendan-donegan) wrote :

Ah, it seems it already has a wrapper script. There must be a bug in there somewhere

Revision history for this message
Jeff Lane  (bladernr) wrote :

IIRC, Rendercheck is guaranteed to fail because it's like FWTS, it runs a ton of smaller tests, any of which could generate a failure that doesn't actually affect operation, and Alberto didn't want to arbitrarily decide what failures were valid or not (they could change from card to card, driver to driver).

Revision history for this message
Brian Sullivan (bsullivan-n) wrote :

Xvfb should be considered the gold standard for rendercheck results and it should be used to determine if a failure is expected or not.

Gradient tests specifically fail even when run against Xvfb and should therefore either not be run or ignored when parsing results. I believe everything else passes when run against Xvfb. I think skipping gradients alone will cause test to pass on most systems and any failures at that point can probably be considered driver bugs.

Revision history for this message
Alberto Milone (albertomilone) wrote :

Absolutely, feel free to disable those tests.

Revision history for this message
Brendan Donegan (brendan-donegan) wrote :

Brian,

Thanks for the info. Armed with that, I can proceed to update the test so that gradients is blacklisted.

Daniel Manrique (roadmr)
Changed in checkbox:
status: In Progress → Fix Committed
Changed in checkbox:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.