Test Automation for Verifying Software's Detectability for ... - Noppa

possehastyMechanics

Nov 5, 2013 (4 years and 7 days ago)

115 views

Test Automation for Verifying
Software’s Detectability for Rule
Violations

Name: Zhishuai Yao

Supervisor: Pro.
Jukka

Manner

Place: Varian Medical Systems Finland
Oy

Outlines


Overview and background


Objectives of the thesis


Design and implementation


Results

and conclusions


Q & A



Overview and Background


This thesis is done in a company which
develops software for radiation therapy in
cancer treatment



Automated tests are created to verify the
error detecting mechanism (“checking
functions”) in the software



Overview and Background


Radiation therapy


Using radiation
beam to irradiate
the tumor.


Requires high
accuracy at tumor
positioning and
dosing the
treatment


Overview and Background



Treatment planning system (TPS)


Computerized application used for simulate the dose
distribution in CT images


Various of inputs to the TPS increases the risk for
radiation therapy

Objectives of the Thesis

Implementing the tests is to:


High level: reduc
ing

the risk in radiation
therapy


Low level: eliminating the errors in the TPS
by verifying the “checking functions” in the
application

Design and Implementation


Testing target: “checking functions”


For each specific violation of rule, checking
function throws error or warning message to
notify the user


Testing method: “black box testing”


Generate faulty cases to violate every predefined
rules and check whether the correct error or
warning message is throw by the “checking
function”

Design and Implementation


Challenges


Understand each rule (requirement) and
find the proper parameter to violate the
rule


Setting the criteria to the test


Short execution time and reusability (e.g.
for regression testing)

Design and Implementation

Design and Implementation


Test procedures:


Importing prerequisite data


Running the checking function for original data


No error or warning should be thrown


Modify specific parameter


Running the checking function again


Expected error or warning should be thrown


Log the result



Results and Conclusions


Automated test has covered 93 rules (requirements) by
the time this thesis was finalized (currently more than
120 )


0.00 %
20.00 %
40.00 %
60.00 %
80.00 %
100.00 %
24th Nov
2010
29th Dec
2010
8th Feb
2011
3rd Mar
2011
5th Apr
2011
30th Apr
2011
Passed
Failed
Results and Conclusions


A
ssociated
warning or error is not shown.


N
on
-
related warning or error is shown in
addition to the correct warning or error
message.


C
orruption
in data model dependency rule.


Some of the mandatory attributes are not
correctly configured in the system.


Thanks for your
attention!


Question & Answer