Opened 8 years ago

Last modified 8 years ago

#1495 closed defect

Fix the mischecking xml output in system tests and refactor the checking process — at Version 2

Reported by: bbell Owned by: Bang Pham Huu
Priority: major Milestone: 9.4
Component: systemtest Version: development
Keywords: test Cc: Dimitar Misev
Complexity: Medium

Description (last modified by Bang Pham Huu)

Update: There was a problem with system test, when output especially in xml always return true from validation. The systemtest need to be fixed.

run test.sh in systemtest/testcases_mandatory/test_nullvalues/test.sh
first time —> everything passes
second time —> encode.rasql fails
third time —> encode.rasql fails
fourth time —> everything passes

After some investigation, the behaviour in lines 839-892 of systemtest/util/common.sh creates redundantly-named output files which conflict with what is being tested on subsequent tests.

Compare lines 854-869 with lines 875-890. The former, which is for *.tiff files, uses $output_tmp, while the latter uses 2>&1 > /dev/null. Could this discrepancy be what is causing the errors in the tests? Perhaps removing the files after comparison could resolve this issue.

Change History (2)

comment:1 by Bang Pham Huu, 8 years ago

Component: undecidedsystemtest
Milestone: 9.4

comment:2 by Bang Pham Huu, 8 years ago

Complexity: EasyMedium
Description: modified (diff)
Summary: test.sh in test_nullvalues passes ONLY on its (1+3k)th runs, where k >= 0.Fix the mischecking xml output in system tests and refactor the checking process
Note: See TracTickets for help on using tickets.