Changes between Initial Version and Version 2 of Ticket #1560
- Timestamp:
- Aug 9, 2017, 2:11:45 PM (7 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Ticket #1560
- Property Summary test_wcps not skipping all known_fails → Rename test wcs, wcps queries, oracles files to be consistent
- Property Component undecided → systemtest
- Property Milestone → 9.5
-
Ticket #1560 – Description
initial v2 1 1 4 known fails are skipped (157, 195, 214, and 53) but the other 4 are not skipped (31, 58, 153, 216) and moreover, the 4 tests which are not skipped happen to pass. Is this a feature or a flaw? If it's a feature (that is, you are checking if previously-known-fails are passing) then perhaps it should be clearer that these are now passing. 2 2 3 '''The tests in known_fails if one of them succeeds, it will return as test passed instead of test skipped, so in example: 31, 58, 153, 216 are passed but they are added in known_fails because they could be passed in on OS like Centos 7 but fail in another OS, such as: Ubuntu, Debian.''' 4 3 5 Furthermore, the test numbering system has some duplicates (e.g. there are 4 tests with the same number, and several cases where two tests have the same test #). 6 7 ''' 8 Queries and oracles files for test wcs, wcps are added unique preifx numbers with pattern: (0 -> 001, 10 -> 010, 100 -> 100). 9 '''