Your help needed: run WebGL 1.0.1 tests in today’s Nightly build

In the WebGL WG, we’re currently asking people to run WebGL 1.0.1 conformance tests in Nightly builds of their favorite browsers, using recent graphics drivers, to see the actual status of passing conformance tests on real drivers.

As far as Firefox is concerned, some important fixes just arrived in today’s (20120417) Nightly builds, and so, if you have recent graphics drivers, I would like very much you to get this build or upgrade to it, and follow these instructions.

We’re interested in this on the 3 main desktop operating systems: Windows, Mac OSX, Linux. And of course, it is also very interesting if you can test that on other browsers, such as: Chrome 20 or Canary, Opera 12, Safari WebKit Nightly builds.

Many thanks!

Update: Huge thanks to everyone who contributed. I have enough data for rigth now, but as fixes and workaround keep landing, it’s always useful to have more people testing in the future. Other browser vendors may also be interested in more testing. I will probably ask for more Firefox testing in a few days once some more workarounds have landed.

Update 2: Time for a second round of testing! See my new post.

17 Responses to “Your help needed: run WebGL 1.0.1 tests in today’s Nightly build”

  1. Daniel Cater says:

    Done and sent.

    Firefox 14 Nightly (2012-04-17), Ubuntu Linux 11.10 64-bit, NVIDIA 280.13, GeForce GT 520

    Tests PASSED: 8916
    Tests FAILED: 3
    Tests TIMED OUT: 0

    Will test again once Ubuntu 12.04 is released (next week).

  2. Daniel Cater says:

    Note that running this in a clean Firefox profile causes the “unencrypted content loaded in an encrypted page” warning.

    This is caused by:

    textures/origin-clean-conformance.html
    more/functions/readPixelsBadArgs.html
    more/functions/texImage2DHTML.html
    more/functions/texSubImage2DHTML.html

    each of which load an image over plain HTTP. I checked and for each of the images, the server has HTTPS so switching shouldn’t be a problem.

  3. bjacob says:

    Interesting, thanks for reporting that problem. Will fix.

  4. TBS says:

    Windows 8 x64, Nightly 14, Nvidia GTX 560Ti driver 296.17:

    http://pastebin.mozilla.org/1575808

  5. Done and send.

    Firefox 14 Nightly 64bit (2012-04-17) on Windows 7 64bit with GTX460 v2 [301.24]

    Test Summary (8879 total tests):
    Tests PASSED: 8861
    Tests FAILED: 18
    Tests TIMED OUT: 0

    Failures:
    conformance/textures/tex-image-and-sub-image-2d-with-image.html: 16 tests failed
    conformance/textures/texture-mips.html: 2 tests failed

  6. Firefox Nightly 14.0a1 (2012-04-17)

    WebGL Renderer: Tungsten Graphics, Inc — Mesa DRI Intel(R) Sandybridge Desktop — 2.1 Mesa 8.0.1

    User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120417 Firefox/14.0a1
    WebGL VENDOR: Mozilla
    WebGL VERSION: WebGL 1.0
    WebGL RENDERER: Mozilla
    Unmasked VENDOR: undefined
    Unmasked RENDERER: undefined
    WebGL R/G/B/A/Depth/Stencil bits (default config): 8/8/8/8/24/0

    ——————-

    Test Summary (8863 total tests):
    Tests PASSED: 8858
    Tests FAILED: 5
    Tests TIMED OUT: 0

    ——————-

    Failures:

    conformance/context/context-attributes-alpha-depth-stencil-antialias.html: 1 tests failed
    conformance/programs/program-test.html: 1 tests failed
    conformance/renderbuffers/framebuffer-object-attachment.html: 3 tests failed

  7. I’ve been trying to run the tests, and have had most of the suite pass, but there’s a crashing bug being triggered somehow, posted a few crash reports from john@nextraweb.com

  8. AV says:

    does it require a new profile or can I use the current one with a little activity?
    And on windows you prefer using angle/native gl or both? I’m using nvidia if it matters.

  9. bjacob says:

    You can use your current profile. On Windows, if you test only one thing, please test ANGLE since that’s the default, but if you have time I’m also very interested in OpenGL.

  10. AV says:

    tested both, and opera, already sent
    errors opera >> fx native > fx angle

  11. martin says:

    @Benoit Jacob; will you generate some charts/tables from the data we’ve provided? For example, it would be nice with a matrix of green/red/yellow boxes where one axis is the gfx card and one axis is the browser version (and Linux vs Windows could be presented as two separate matrices).

  12. Chiana says:

    Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:14.0) Gecko/20120419 Firefox/14.0a1

    Adapter Description AMD Radeon HD 6800 Series
    Driver Version 8.960.0.0
    Driver Date 3-15-2012
    WebGL Renderer Google Inc. — ANGLE (AMD Radeon HD 6800 Series) — OpenGL ES 2.0 (ANGLE 1.0.0.1041)

    WebGL Conformance Test Results
    Version 1.0.1

    ——————-

    User Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:14.0) Gecko/20120419 Firefox/14.0a1
    WebGL VENDOR: Mozilla
    WebGL VERSION: WebGL 1.0
    WebGL RENDERER: Mozilla
    Unmasked VENDOR: undefined
    Unmasked RENDERER: undefined
    WebGL R/G/B/A/Depth/Stencil bits (default config): 8/8/8/8/24/0

    ——————-

    Test Summary (8883 total tests):
    Tests PASSED: 8849
    Tests FAILED: 34
    Tests TIMED OUT: 0

    ——————-

    Failures:

    conformance/textures/gl-teximage.html: 10 tests failed
    conformance/textures/tex-image-and-sub-image-2d-with-image.html: 16 tests failed
    conformance/textures/tex-image-with-format-and-type.html: 8 tests failed

  13. bjacob says:

    martin, I’m not sure I’ll have the time to do that, but anyone can do it as the data is public: just use the archives of the newsgroup (even better, subscribe to it):

    http://groups.google.com/group/webgl-driver-testing

  14. Jools Adams says:

    I’m trying this on the current 13” Macbook Pro model. This has 0SX Lion, 4GB of RAM and the integrated HD3000 / Sandybridge graphics. Unfortunately Firefox crashes before completing the tests.

    I get the offer of submitting the crash to Apple (which I do). Do you get these crash dumps at Mozilla?

  15. bjacob says:

    No, when Apple’s crash reporter replace ours, we don’t get any crash report. We don’t have access to Apple’s crash database, as far as I know.

    If there is a way to disable Apples’ crash reporter for Firefox, please try that, and then, please go to about:crashes in Firefox and give us the crash links.

    Anyway, Apple’s Intel graphics driver is one of the worst of any platform; we have no hope of passing all conformance tests on these configurations, but we do want to avoid crashing.

  16. Jools Adams says:

    I’ve tried disabling Apple’s crash reporter, which seems to have been successful. Unfortunately the Firefox crash reporter isn’t doing it’s stuff. I’m not sure what to do?

  17. bjacob says:

    Jools, sorry, I really don’t have much experience with Mac. We definitely get crash reports from Macs, so it can’t be hard. Maybe see if http://kb.mozillazine.org/Breakpad has useful info or ask support.mozilla.org

Leave a Reply