Across 18 recent runs of the Lion Debug WebKit2 test bot, each one of these appcache tests has failed at least once: http/tests/appcache/access-via-redirect.php http/tests/appcache/auth.html http/tests/appcache/crash-when-navigating-away-then-back.html http/tests/appcache/credential-url.html http/tests/appcache/different-scheme.html http/tests/appcache/document-write-html-element-2.html http/tests/appcache/empty-manifest.html http/tests/appcache/fallback.html http/tests/appcache/foreign-fallback.html http/tests/appcache/foreign-iframe-main.html http/tests/appcache/idempotent-update.html http/tests/appcache/local-content.html http/tests/appcache/main-resource-hash.html http/tests/appcache/main-resource-redirect.html http/tests/appcache/manifest-parsing.html http/tests/appcache/manifest-with-empty-file.html http/tests/appcache/offline-access.html http/tests/appcache/online-fallback-layering.html http/tests/appcache/online-whitelist.html http/tests/appcache/progress-counter.html http/tests/appcache/reload.html http/tests/appcache/remove-cache.html http/tests/appcache/simple.html http/tests/appcache/top-frame-1.html http/tests/appcache/top-frame-2.html http/tests/appcache/top-frame-3.html http/tests/appcache/top-frame-4.html http/tests/appcache/update-cache.html http/tests/appcache/video.html http/tests/appcache/whitelist-wildcard.html http/tests/appcache/wrong-content-type.html http/tests/appcache/xhr-foreign-resource.html It’s likely that the reason is that running appcache tests concurrently causes them to fail.
<rdar://problem/11108649>
Added http/tests/appcache to the Mac WebKit2 skip list in <http://trac.webkit.org/r111868>.
I think I've seen this on the chromium bots as well, so I wouldn't be too surprised by this.
Added http/tests/inspector/appcache to the Mac WebKit2 skip list in <http://trac.webkit.org/r111879>.
On the other hand, I now recall that NRWT was supposed to run tests within a single directory sequentially. Is this still the case?
(In reply to comment #5) > On the other hand, I now recall that NRWT was supposed to run tests within a single directory sequentially. Is this still the case? Even if that’s the case, we may have cross-talk between http/tests/appcache and http/tests/inspector/appcache.
(In reply to comment #6) > (In reply to comment #5) > > On the other hand, I now recall that NRWT was supposed to run tests within a single directory sequentially. Is this still the case? > > Even if that’s the case, we may have cross-talk between http/tests/appcache and http/tests/inspector/appcache. Yes, NRWT runs tests within a single directory sequentially unless you run with the -f / --fully-parallel flag.
Enabled the tests in <http://trac.webkit.org/r169006>, and bots haven't seen any failures so far. Notably, we don't have anything in http/tests/inspector/appcache now.