Changes between Initial Version and Version 2 of Ticket #1560


Ignore:
Timestamp:
Aug 9, 2017, 2:11:45 PM (7 years ago)
Author:
Bang Pham Huu
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #1560

    • Property Summary test_wcps not skipping all known_failsRename test wcs, wcps queries, oracles files to be consistent
    • Property Component undecidedsystemtest
    • Property Milestone9.5
  • Ticket #1560 – Description

    initial v2  
    114 known fails are skipped (157, 195, 214, and 53) but the other 4 are not skipped (31, 58, 153, 216) and moreover, the 4 tests which are not skipped happen to pass. Is this a feature or a flaw? If it's a feature (that is, you are checking if previously-known-fails are passing) then perhaps it should be clearer that these are now passing.
    22
     3'''The tests in known_fails if one of them succeeds, it will return as test passed instead of test skipped, so in example: 31, 58, 153, 216 are passed but they are added in known_fails because they could be passed in on OS like Centos 7 but fail in another OS, such as: Ubuntu, Debian.'''
     4
    35Furthermore, the test numbering system has some duplicates (e.g. there are 4 tests with the same number, and several cases where two tests have the same test #).
     6
     7'''
     8Queries and oracles files for test wcs, wcps are added unique preifx numbers with pattern: (0 -> 001, 10 -> 010, 100 -> 100).
     9'''