Bug 142226 - [iOS] TestExpectations for ios-simulator-wk2 should fall back to 'wk2' after 'ios-simulator'
Summary: [iOS] TestExpectations for ios-simulator-wk2 should fall back to 'wk2' after ...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: David Kilzer (:ddkilzer)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2015-03-03 10:42 PST by David Kilzer (:ddkilzer)
Modified: 2015-03-05 20:05 PST (History)
9 users (show)

See Also:


Attachments
Patch v1 (1.55 KB, patch)
2015-03-03 10:46 PST, David Kilzer (:ddkilzer)
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description David Kilzer (:ddkilzer) 2015-03-03 10:42:46 PST
LayoutTests/platform/wk2/TestExpectations contains expectations for all (or Apple-only?) WebKit2 ports, so they are less-specific than LayoutTests/platform/ios-simulator/TestExpectations, which are shared test expectations for both WK1 and WK2 tests on iOS Simulator.

The current order for ios-simulator-wk2 is this:  ios-simulator-wk2, wk2, ios-simulator

I propose changing it to this:  ios-simulator-wk2, ios-simulator, wk2

This has the additional benefit of fixing the expected results for this test because it's marked as [ Failure ] in wk2, but [ Skip ] in ios-simulator:

fast/dynamic/window-resize-scrollbars-test.html
Comment 1 David Kilzer (:ddkilzer) 2015-03-03 10:46:45 PST
Created attachment 247770 [details]
Patch v1
Comment 2 David Kilzer (:ddkilzer) 2015-03-03 10:49:34 PST
(In reply to comment #0)
> This has the additional benefit of fixing the expected results for this test
> because it's marked as [ Failure ] in wk2, but [ Skip ] in ios-simulator:
> 
> fast/dynamic/window-resize-scrollbars-test.html

And I think switching the order of test expectations for ios-simulator-wk2 is better than trying to move the [ Failure ] expectation from platform/wk2/TestExpectations to somewhere else (namely each port-specific TestExpectations file).
Comment 3 Alexey Proskuryakov 2015-03-03 10:52:30 PST
What is the order on Mac?

For expected results, it's "mac-wk2 -> wk2 -> mac-mavericks -> mac -> generic" (on Mavericks), but I'm not quite sure what the order is for TestExpectations.
Comment 4 David Kilzer (:ddkilzer) 2015-03-03 11:30:36 PST
(In reply to comment #3)
> What is the order on Mac?
> 
> For expected results, it's "mac-wk2 -> wk2 -> mac-mavericks -> mac ->
> generic" (on Mavericks), but I'm not quite sure what the order is for
> TestExpectations.

For mac-yosemite-wk2, it is:  mac-wk2, wk2, mac

Which is basically the same as the "Baseline search path" without "generic" at the end.

I assume the TestExpectations files are parsed in the same order as the test results, or nothing would really make sense.  :)

What am I missing here?  Should the [ Failure ] result for fast/dynamic/window-resize-scrollbars-test.html move out of wk2/TestExpectations (and into mac-wk2/TestExpectations?) so the [ Skip ] result in ios-simulator/TestExpectations is recognized?
Comment 5 Darin Adler 2015-03-05 19:21:06 PST
Oops, I didn’t see Alexey’s question.
Comment 6 WebKit Commit Bot 2015-03-05 20:04:55 PST
Comment on attachment 247770 [details]
Patch v1

Clearing flags on attachment: 247770

Committed r181131: <http://trac.webkit.org/changeset/181131>
Comment 7 WebKit Commit Bot 2015-03-05 20:05:01 PST
All reviewed patches have been landed.  Closing bug.