Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Firefox passing more tests but having a lower percentage than Chrome #225

Open
SebastianZ opened this issue Jan 14, 2022 · 2 comments
Open
Labels

Comments

@SebastianZ
Copy link
Collaborator

Firefox 96.0 is passing two more tests than Chrome 97.0 for the experimental features but has two percentage points less.

Firefox passing more tests but having a lower percentage than Chrome

I didn't investigate yet why that happens, just wanted to post it here. My guess is it has to do with partial value support. Though maybe someone can explain it.

Sebastian

@SebastianZ SebastianZ added the bug label Jan 14, 2022
@LeaVerou
Copy link
Owner

How do we count partial passes? Maybe we shouldn't be incrementing by 1, but a fraction?

@SebastianZ
Copy link
Collaborator Author

I realized that this is related to how we calculate the overall support.

It's related to the supported features, not to the tests passed. An example is Animations Level 2. There we have 10 tests and Firefox only passes 1. Though that one test indicates support for 1 of 3 features, so the overall support is 33%.

To avoid confusion, I suggest to change the calculation of the support to be based on the number of passed tests in comparison to the total number of tests instead.

Any other ideas?

Sebastian

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants