Opened 8 years ago
Last modified 7 years ago
#1560 closed defect
Rename test wcs, wcps queries, oracles files to be consistent — at Version 2
Reported by: | bbell | Owned by: | Bang Pham Huu |
---|---|---|---|
Priority: | major | Milestone: | 9.5 |
Component: | systemtest | Version: | development |
Keywords: | Cc: | Bang Pham Huu | |
Complexity: | Medium |
Description (last modified by )
4 known fails are skipped (157, 195, 214, and 53) but the other 4 are not skipped (31, 58, 153, 216) and moreover, the 4 tests which are not skipped happen to pass. Is this a feature or a flaw? If it's a feature (that is, you are checking if previously-known-fails are passing) then perhaps it should be clearer that these are now passing.
The tests in known_fails if one of them succeeds, it will return as test passed instead of test skipped, so in example: 31, 58, 153, 216 are passed but they are added in known_fails because they could be passed in on OS like Centos 7 but fail in another OS, such as: Ubuntu, Debian.
Furthermore, the test numbering system has some duplicates (e.g. there are 4 tests with the same number, and several cases where two tests have the same test #).
Queries and oracles files for test wcs, wcps are added unique preifx numbers with pattern: (0 → 001, 10 → 010, 100 → 100).
Change History (2)
comment:1 by , 8 years ago
Component: | undecided → systemtest |
---|---|
Milestone: | → 9.5 |
comment:2 by , 7 years ago
Description: | modified (diff) |
---|---|
Summary: | test_wcps not skipping all known_fails → Rename test wcs, wcps queries, oracles files to be consistent |