Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add percentage of subtests to wpt.servo.org #51

Open
mrego opened this issue Feb 18, 2025 · 0 comments
Open

Add percentage of subtests to wpt.servo.org #51

mrego opened this issue Feb 18, 2025 · 0 comments

Comments

@mrego
Copy link
Member

mrego commented Feb 18, 2025

Right now people are usually confused when they compare the results at wpt.servo.org vs wpt.fyi. For example:

Test suite wpt.servo.org wpt.fyi
All 62% 78.7% (1527155 / 1939497)
/css 68% 49.6% (81871 / 165034)
/css/CSS2 84.8% 86.5% (7423 / 8578)

We've added an explanation:

Scores are calculated as percentages of total enabled tests within the suite that pass. A passing test with no subtests gets a score of 1 while a test with subtests gets a score between 0 and 1 representing the fraction of passing subtests within that test. This is different from the percentages on wpt.fyi which is calculated by giving equal weight to both top-level tests and subtests.

But still it'd be useful if we can also show the percentage of subtests in wpt.servo.org, so we'll have 2 numbers for each folder (we could even have 2 lines in the chart).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant