Opened 8 years ago

Last modified 7 years ago

#1560 closed defect

Rename test wcs, wcps queries, oracles files to be consistent — at Version 2

Reported by: bbell Owned by: Bang Pham Huu
Priority: major Milestone: 9.5
Component: systemtest Version: development
Keywords: Cc: Bang Pham Huu
Complexity: Medium

Description (last modified by Bang Pham Huu)

4 known fails are skipped (157, 195, 214, and 53) but the other 4 are not skipped (31, 58, 153, 216) and moreover, the 4 tests which are not skipped happen to pass. Is this a feature or a flaw? If it's a feature (that is, you are checking if previously-known-fails are passing) then perhaps it should be clearer that these are now passing.

The tests in known_fails if one of them succeeds, it will return as test passed instead of test skipped, so in example: 31, 58, 153, 216 are passed but they are added in known_fails because they could be passed in on OS like Centos 7 but fail in another OS, such as: Ubuntu, Debian.

Furthermore, the test numbering system has some duplicates (e.g. there are 4 tests with the same number, and several cases where two tests have the same test #).


Queries and oracles files for test wcs, wcps are added unique preifx numbers with pattern: (0 → 001, 10 → 010, 100 → 100).

Change History (2)

comment:1 by Bang Pham Huu, 8 years ago

Component: undecidedsystemtest
Milestone: 9.5

comment:2 by Bang Pham Huu, 7 years ago

Description: modified (diff)
Summary: test_wcps not skipping all known_failsRename test wcs, wcps queries, oracles files to be consistent
Note: See TracTickets for help on using tickets.