Status of Empirical Research in Software Engineering

cabbagepatchtapeInternet και Εφαρμογές Web

5 Φεβ 2013 (πριν από 4 χρόνια και 4 μήνες)

109 εμφανίσεις

Universität Karlsruhe (TH)

Research University
∙ founded 1825

Status of Empirical Research in

Software Engineering

The first 10
½

years of the Journal of Empirical
Software Engineering


Andreas Höfer

Walter F. Tichy

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

2

Motivation


Check the health of empirical software
engineering research


ESE is the major venue for publishing empirical
results in software research; it thus provides a
representative sample.


Other publications were not considered



Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

3

Data


All issues from volume 1, number 1 (Jan. 1996)

to volume 11, number 2 (Jun. 2006) of ESE


Classified 133 reviewed articles


Not included:


50 editorials


30 viewpoints/position papers


15 conference/workshop reports


6 comments/correspondence papers


Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

4

Classification Schemas


Research approach


Experiment, case study, tool/method/framework...


Source of data


Professionals, students, benchmarks...


Domain of study


Metrics, software process, inspections/reviews...

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

5

Research Approach

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

6

Replications


14 replications among the

53 (controlled) experiments (
~
26 %)

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

7

Source of Data

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

8

Domain of Study

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

9

What is missing?


Programming languages


OO languages


Functional languages


Imperative languages


Script languages (Perl, Python, Ruby, …)


Web application tools (Ajax, …)


Aspect orientation


Design notations


Model driven development


Formal Methods


Standardized software (SAP)


Theories/models/explanations/predictions


Long
-
term studies


Meyers/Briggs categories in relation to task profiles


….

Status of Empirical Research in Software Engineering
Andreas Höfer, Walter F. Tichy

10

Are their any really important
results?


Does empirical work really advance the field of
software engineering?


Or is it OK and necessary, but the exiting stuff
happens elsewhere?


Is empirical work dull and uninspiring?


So what is great about doing empirical work?


What are the great insights?