Status Calculation
How is the Status of the Test/Suite are calculated
Status
PASSED
PASSED
It's to mention that it worked successfully as it was meant to
FAILED
FAILED
it's not working fine as expected. An error will be attached to this case.
SKIPPED
SKIPPED
it's to mention that it got skipped as it was intended to. Reason would be mentioned for this case.
XFAILED
XFAILED
it failed but it was expected
XPASSED
XPASSED
it was supposed to fail but got passed
Data Stored
Assertion
User Given
AssertBase, "Passed"
Passed - True / False
Test Case
User Given
SuiteBase, "standing"
PASSED/FAILED/SKIPPED/XFAILED/XPASSED
Test Suite
Calculated
SuiteBase, "standing"
PASSED/FAILED/SKIPPED/XFAILED/XPASSED
Calculation of the Status of the Test Suite
we call a Test Entity to be a Test Suite since it would have collection test cases under it or another collection (Test Suite), which why with reference to the Test Status of the test cases we calculate the status of the Test Suite
We Do the following to find the status of the Test Suite:
PASSED, FAILED, XPASSED, ....
FAILED
Since one of the test cases under it failed
PASSED, PASSED, ...
PASSED
Since all the test cases were passed
FAILED, SKIPPED, PASSED...
FAILED
Since one of the test cases under it failed
SKIPPED, SKIPPED
SKIPPED
Since all the test cases were skipped
PASSED, SKIPPED
PASSED
Since none of them failed and at least one of them have passed
XPASSED, PASSED
XPASSED
Since none of them failed and one of them was XPASSED
XFAILED, SKIPPED
XFAILED
Since none of them failed and passed and one of them was XFAILED
Calculation of the Status of the Test Run
Same logic is applied to find the status of the test run here it is based on the statuses of the Test Suites.
Last updated