Java GUI testing with Marathon

Java GUI testing
with Marathon
Software Analysis and Testing
Cu Nguyen Duy
(cunduy at fbk dot eu)
Alessandro Marchetto
(marchetto at fbk dot eu)
Paolo Tonella
(tonella at fbk dot eu)
Mariano Ceccato
(ceccato at fbk dot eu)
Academic Year 2011-2012
Wednesday, October 12, 11
Marathon
•
Capture and playback tool for testing Java/Swing graphical user
interfaces.
(
www.marathontesting.com)
•
Uses the “Jython” (Python for Java) and JRuby scripting languages
to store test cases.
•
Test cases can be captured interactively, or written as Jython,
JRuby scripts.
•
Allows to insert assertions in the script easily, using a specific GUI
•
Shows testing results using JUnit’s control bar
User Guide: http://www.marathontesting.com/Marathon_-_Java_GUI_Testing_files/Marathon%20User%20Guide.pdf
Wednesday, October 12, 11
Getting start with
Marathon

 
A calculator application
was developed (Swing)

 
We want to write tests
for the calculator

 
Ex. add two values

 
Steps:
1.
 
create a new Marathon
project
2.
 
create a new empty test
(a test is a Python script
file)
3.
 
build and run the test
(recording/replay)
4. generate reports
url:
http://selab.fbk.eu/swat/projects/swing-calculator.tgz
Wednesday, October 12, 11
1. Create a new Marathon project
•
Launch Marathon
•
Click on the
New...
button
to create a new project
•
Name
the project (e.g.
Swing-Calculator-Test)
•
Specify
Directory
(e.g
same workspace)
•
Set
Main Class t
o the main
class of the project
(Calculator)
•
Set the
Class path
•
bin
(output) folder of
eclipse project
•
jar libs (if any)
Wednesday, October 12, 11
2. Recording a test
•
File > New >
Exploratory Test
•
Wait for the
application to be
launched
•
Interact with the
App to record
events
•
Insert assertions
(
Ctl-RightClick
or
Cmd-RightClick
)
on controls
Wednesday, October 12, 11
3. Test execution
•
Modify, improve recorded test cases if necessary
•
You can record more for a test case with recording, recorded
code will be inserted at the current position of the cursor
•
Click on
Play
to run a test case
Wednesday, October 12, 11
4. Generate report
•
Select
Marathon >
Generate Reports
•
Reports are stored
in TestReports
•
Open them with a
browser or select
Marathon > Show
Repor
ts
Wednesday, October 12, 11
Exercises
1.
Record the following test: 123+456
2.
Insert assertion to check if the result is 579.0
3.
Adding more tests
a.
123*56
b.
213234-1234
c.
1/0
4.
Modify the test (a) to 123*$1
Wednesday, October 12, 11
Testing Jabref GUI
with Marathon
Wednesday, October 12, 11
Project settings
(recommended)
Name the project
jabref-gui-test
Directory
a subfolder of Eclipse Jabref project
Main Class
net.sf.jabref.JabRefMain
Class path
- bin folder of Eclipse jabref project
- jar: build/lib/Jabref-2.7.jar (*)
(*) if the file does not exist, do one of the followings:
- install Apache Ant and run
ant
(with out any argument) within the
jabref project to generate that file
- open Ant View of Eclipse, drag-drop the file
build.xml
into the view,
double click on the
jars
task
- replace that jar file with all the jars required by jabref (take a look at
the
classpath

specification in the
build.xml
file)
Wednesday, October 12, 11
Testing Jabref GUI
•
All the GUI components you are developing should
be tested
•
for fault detection
•
for increasing
Coverage Score
•
Jabref GUI testing with coverage:
1.
instrument jabref built code with
Coverage Tool
2.
run Marathon test cases as normal
Wednesday, October 12, 11
Exercise
•
Setup a Marathon project for Jabref
•
Record the following events: Open a BibTeX
Database > Select an item > Delete that item > Close
the Databae
•
Modify the recorded code, substitute the previously
selected file with another
•
Run the test and check the report
Wednesday, October 12, 11