Opened 8 years ago
Last modified 8 years ago
#1495 closed defect
Fix the mischecking xml output in system tests and refactor the checking process — at Version 2
Reported by: | bbell | Owned by: | Bang Pham Huu |
---|---|---|---|
Priority: | major | Milestone: | 9.4 |
Component: | systemtest | Version: | development |
Keywords: | test | Cc: | Dimitar Misev |
Complexity: | Medium |
Description (last modified by )
Update: There was a problem with system test, when output especially in xml always return true from validation. The systemtest need to be fixed.
run test.sh in systemtest/testcases_mandatory/test_nullvalues/test.sh
first time —> everything passes
second time —> encode.rasql fails
third time —> encode.rasql fails
fourth time —> everything passes
After some investigation, the behaviour in lines 839-892 of systemtest/util/common.sh creates redundantly-named output files which conflict with what is being tested on subsequent tests.
Compare lines 854-869 with lines 875-890. The former, which is for *.tiff files, uses $output_tmp, while the latter uses 2>&1 > /dev/null. Could this discrepancy be what is causing the errors in the tests? Perhaps removing the files after comparison could resolve this issue.
Change History (2)
comment:1 by , 8 years ago
Component: | undecided → systemtest |
---|---|
Milestone: | → 9.4 |
comment:2 by , 8 years ago
Complexity: | Easy → Medium |
---|---|
Description: | modified (diff) |
Summary: | test.sh in test_nullvalues passes ONLY on its (1+3k)th runs, where k >= 0. → Fix the mischecking xml output in system tests and refactor the checking process |