Bug 217617 - [ macOS iOS ] 2 imported/w3c/web-platform-tests/service-workers/service-worker/* tests are flaky failures
Summary: [ macOS iOS ] 2 imported/w3c/web-platform-tests/service-workers/service-worke...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
: 217615 217616 (view as bug list)
Depends on:
Blocks:
 
Reported: 2020-10-12 10:41 PDT by Hector Lopez
Modified: 2020-10-13 11:56 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hector Lopez 2020-10-12 10:41:24 PDT
imported/w3c/web-platform-tests/service-workers/service-worker/navigate-window.https.html 
imported/w3c/web-platform-tests/service-workers/service-worker/clients-matchall-order.https.html

Test are flaky failing according to history on macOS and iOS. First occurrence of failure is at r267608

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fnavigate-window.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fclients-matchall-order.https.html&limit=50000&platform=ios&platform=mac

Was able to reproduce on r267608 with 

run-webkit-tests imported/w3c/web-platform-tests/service-workers/service-worker/navigate-window.https.html --iterations 100 --exit-after-n-failures 3

run-webkit-tests imported/w3c/web-platform-tests/service-workers/service-worker/clients-matchall-order.https.html --iterations 100 --exit-after-n-failures 3


Diffs:

imported/w3c/web-platform-tests/service-workers/service-worker/navigate-window.https.html 

--- /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/navigate-window.https-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/navigate-window.https-actual.txt
@@ -1,4 +1,4 @@
 
 PASS Clients.matchAll() should not show an old window as controlled after it navigates.
-FAIL Clients.matchAll() should not show an old window after it navigates. assert_unreached: unexpected rejection: assert_equals: expected number of clients expected 3 but got 2 Reached unreachable code
+FAIL Clients.matchAll() should not show an old window after it navigates. assert_unreached: unexpected rejection: assert_equals: expected number of clients expected 3 but got 7 Reached unreachable code
 


imported/w3c/web-platform-tests/service-workers/service-worker/clients-matchall-order.https.html:

--- /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/clients-matchall-order.https-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/clients-matchall-order.https-actual.txt
@@ -2,8 +2,8 @@
 PASS Clients.matchAll() returns non-focused controlled windows in creation order.
 FAIL Clients.matchAll() returns controlled windows in focus order.  Case 1. assert_equals: expected URL index 0 expected "https://localhost:9443/service-workers/service-worker/resources/empty.html?name=focus-controlled-windows-1&q=2" but got "https://localhost:9443/service-workers/service-worker/resources/empty.html?name=focus-controlled-windows-1&q=0"
 PASS Clients.matchAll() returns controlled windows in focus order.  Case 2.
-FAIL Clients.matchAll() returns non-focused uncontrolled windows in creation order. assert_equals: expected 6 but got 5
-FAIL Clients.matchAll() returns uncontrolled windows in focus order.  Case 1. assert_equals: expected 6 but got 5
-FAIL Clients.matchAll() returns uncontrolled windows in focus order.  Case 2. assert_equals: expected 6 but got 5
+FAIL Clients.matchAll() returns non-focused uncontrolled windows in creation order. assert_equals: expected 6 but got 10
+FAIL Clients.matchAll() returns uncontrolled windows in focus order.  Case 1. assert_equals: expected 6 but got 10
+FAIL Clients.matchAll() returns uncontrolled windows in focus order.  Case 2. assert_equals: expected 6 but got 10
 FAIL Clients.matchAll() returns controlled windows and frames in focus order. assert_equals: expected URL index 0 expected "https://localhost:9443/service-workers/service-worker/resources/empty.html?name=focus-controlled-nested-windows&q=2" but got "https://localhost:9443/service-workers/service-worker/resources/empty.html?name=focus-controlled-nested-windows&q=0"
Comment 1 Radar WebKit Bug Importer 2020-10-12 10:41:42 PDT
<rdar://problem/70213637>
Comment 2 Hector Lopez 2020-10-12 10:57:02 PDT
Test expectations while investigated:

https://trac.webkit.org/changeset/268364/webkit
Comment 3 Truitt Savell 2020-10-13 11:54:31 PDT
*** Bug 217615 has been marked as a duplicate of this bug. ***
Comment 4 Truitt Savell 2020-10-13 11:56:11 PDT
*** Bug 217616 has been marked as a duplicate of this bug. ***