Opened 7 years ago
Closed 7 years ago
#1495 closed defect (fixed)
Fix the mischecking xml output in system tests and refactor the checking process
| Reported by: | bbell | Owned by: | Bang Pham Huu |
|---|---|---|---|
| Priority: | major | Milestone: | 9.4 |
| Component: | systemtest | Version: | development |
| Keywords: | test | Cc: | Dimitar Misev |
| Complexity: | Medium |
Description (last modified by )
Update: There was a problem with system test, when output especially in xml always return true from validation. The systemtest need to be fixed.
run test.sh in systemtest/testcases_mandatory/test_nullvalues/test.sh
first time —> everything passes
second time —> encode.rasql fails
third time —> encode.rasql fails
fourth time —> everything passes
After some investigation, the behaviour in lines 839-892 of systemtest/util/common.sh creates redundantly-named output files which conflict with what is being tested on subsequent tests.
Compare lines 854-869 with lines 875-890. The former, which is for *.tiff files, uses $output_tmp, while the latter uses 2>&1 > /dev/null. Could this discrepancy be what is causing the errors in the tests? Perhaps removing the files after comparison could resolve this issue.
Change History (3)
comment:1 by , 7 years ago
| Component: | undecided → systemtest |
|---|---|
| Milestone: | → 9.4 |
comment:2 by , 7 years ago
| Complexity: | Easy → Medium |
|---|---|
| Description: | modified (diff) |
| Summary: | test.sh in test_nullvalues passes ONLY on its (1+3k)th runs, where k >= 0. → Fix the mischecking xml output in system tests and refactor the checking process |
comment:3 by , 7 years ago
| Resolution: | → fixed |
|---|---|
| Status: | new → closed |
The patch was applied, also the problem Brennan found also not appear again.