Difference between revisions of "Testing Central"
(→REGRESSION TESTING: fixed regressions) |
(→REGRESSION TESTING) |
||
| Line 87: | Line 87: | ||
| {{rev|39654}} | | {{rev|39654}} | ||
| Still present in {{rev|43812}}. Guilty commit: {{rev|39654}} - "Fixes {{Bug|4114}}" | | Still present in {{rev|43812}}. Guilty commit: {{rev|39654}} - "Fixes {{Bug|4114}}" | ||
| − | + | ||
} | } | ||
Revision as of 22:30, 3 May 2010
Welcome to the Testing Central! Here we can coordinate our efforts, this is useful in case you don't have access to or aren't in IRC. To fill the tables just follow the easy understandable guidelines. If you don't understand them please ask in the IRC channel #reactos-testers. Thanks!
Contents
DEVELOPERS REQUEST
Here any developer can ask testers for a test: i.e. a testbox, an application, or a patch. The request can be fulfilled just by a developer. Testers can fill in the result report. While you are about to test a revision, change the tester field and set the LRT to T+number(i.e. T40020) so other testers know you are testing this revision. After testing and knowing the result change the T to R (i.e. R40020) and update the result field.
- DEV: Name of the developer who asked for a test.
- Request: A short description ( i.e. Test for FF mouse bug).
- Application/TestBox: A link to the application (if needed), please use Wiki syntax.
- Way of Testing: A link to a Bugzilla report where the testing steps are described or a short overview of how to test. Please try to keep it short.
- Tester: The name of the tester who did the testing.
- LRT (Last Revision Tested): Add a letter before the number, T means currently testing, R means tested
- RES: Results of the test: failed or no failure.
| Dev | Request | App/TestBox | Way of Testing | Tester | LRT | Res: |
|---|---|---|---|---|---|---|
| Devname | Short Description | Download it:HERE | Open the menu and check if font spacing still wrong, etc. | TestrNam | r40xxx | FAIL |
REGRESSION TESTING
Here any developer or tester who finds a regression can add a line, so that testers can easily keep track of running regression tests and to allow the coordination of the efforts. If you discovered the regression then add your name, the regression description and in which Virtual Machines did you test it. Also add a revision where the bug was not present and the failing one (if you have that information). If you are regression testing, then add (don't delete others testing efforts) the testing revision that you are going to test in the testing field (add your 4 first nick letters). If there are more testers regtesting you will see the revisions they are going to test. It will help you to choose the most interesting revision. We recommend the binary search. When you finished testing a revision, update the Working/Failing and the VMW/QEM/VBX columns. Also delete your testing revision number from the testing.
- Name: The name of the developer or tester who found the regression.
- Regression: Description of the regression, or a link to a Bugzilla report.
- VMWA : "Yes" if the regression happens in VMware, "NO" if doesn't. "NTD" if Not Tested.
- QEMU : "Yes" if the regression happens in QEMU, "NO" if doesn't. "NTD" if Not Tested.
- VBOX : "Yes" if the regression happens in VirtualBox, "NO" if doesn't. "NTD" if Not Tested.
- RHDW : "Yes" if the regression happens in Real Hardware, "NO" if doesn't. "NTD" if Not Tested.
- WRKs: Number of the revision where the bug isn't present.
- Fails: Number of the revision where the bug is failing.
- Testing: Before going to test (before downloading the revision indeed) add your number and your three letters here (i.e. 40100VIC).
| Name | Regression | VMWA | QEMU | VBOX | RHDW | Works | Fails | Testing | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DEV/TES | Regression description | YES | YES | NTD | NTD | 40102 | 40235 | 40180CAE,40210VIC,40150AMI, | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Ey3 | Acrobat Reader 6 | NTD | NTD | NTD | YES | r39653 | r39654 | Still present in r43812. Guilty commit: r39654 - "Fixes #4114"
} TESTING APPSIMPORTANT NOTICE: Testing APPS is being currently moved to the greatest, impresive, astonishing and new Compatibility Database. So it will keep the Database updated and at the same time we can track easily GoldenApps and CandidateApps.The current tables will be adapted to link to those Apps in Compatibility Database.If you want to search GoldenApps and CandidateApps just write GoldenApps in the SearchBox. As this tracks just revisions and not releases, select in the Options just to show Revisions. More info soon...
If you see an application, which hasn't been tested with a virtual machine that you have installed, then please test it.Then fill the Virtual Machine column,and if you find any Bugs,add them in the debug description(i.e. QEM+VMW: It fails when copying.). If the three virtual machines have the same issue change the QEM+VMW+VBX to ALL.
GOLDENAPPSDuring this Week the Testing Revision will be: 44317
CandidateAPPS
Make sure the bug happens only in ReactOS and is not a bug that also happens in Windows. If it happens in both then you should consult with the applications support or Dev team. You should, if possible, try different versions of Windows, making sure to use versions the application is meant to work with. If the bug happens on some versions of Windows and in ReactOS, it is probably not ReactOS.
What makes an application importantThe applications being tracked are not being tracked because of only their popularity or because someone likes the application a lot, there are more important reasons.
Because tracking too many applications at this level of detail is difficult you should not just add another application to the list. New additions to this list should be discussed with Fireball, Caemyr, vicmarcal on IRC or their talk page. But before that you should ask yourself these questions:
If you can answer yes to two of the first three and the fourth then you might consider asking in IRC about adding it. Tracking other applicationsYou can track the app yourself but note that it will be your responsibility to test your applications and report any bugs. You must also make sure the bugs are not reproducible on the current version/versions of Windows, in case the bug is in the application and not in the operating system. If you are still interested your best option is to track the bug on your user page. You can copy the above apps table and edit it for this. |
