Opera ng System Compa bility Analysis of Eclipse and ...

kaputmaltwormΛογισμικό & κατασκευή λογ/κού

15 Αυγ 2012 (πριν από 5 χρόνια και 2 μέρες)

399 εμφανίσεις

Opera&ng  System  Compa&bility  Analysis  of  
Eclipse  and  Netbeans  Based  on  Bug  Data

Xinlei Wang, Eilwoo Baik and Prem Devanbu

1
Outline


Introduction



Results and Analysis


Number of bugs


Total number, per reporter and heavy reporter


Level of bug severity


Bug reopen rate


Bug turnaround time



Conclusion
2
Introduction


Objective


Which  Java  IDE  (Eclipse  and  Netbeans)  has  be7er  
compa;bility/stability  over  different  opera;ng  
systems  (Windows,  Linux  and  Mac  OS)  


Based  on  analysis  of  their  bug  data  


Metrics


Number  of  Bugs  (total  and  per-­‐reporter)  


Propor;on  of  high-­‐severity  bugs  


Bug  reopen  rate  


Bug  turnaround  ;me  
3
Number of Bugs
4
  


#% !!$$ #" 

#"!!"# #
 
##! $#$"
!
% $"#%!$#
"
 !" " #
#
  %"!# 
$
%#  %%% % %

!

!

!

!
   



 
!
"
#
$

   

  ! "

 !" "

  # #

# !  
 
#  "   #
!
#   "" #
"
#! # !"








 




 
!
"


Bugs  categorized  the  by  year  


Eclipse  


On  
Windows
,  number  of  Bugs  sharply  increased  in  2004  and  2005  and  then  stabilized  


On  
Linux
 and  
Mac
,  number  of  bugs  increased  slowly  up  to  2008  


Netbeans    


Similar  trend  for  all  three  opera;ng  systems  
Number of Bugs Per Reporter
5
! &
&#
%!
&$
$!
$"
' 
$&
$$
'#
$'
% 
&#
$#
$%
'!
%"
%%
&&
&!
&(
 
" 
$ 
& 
( 
!  
!" 
   


" "
" #
" $
" %
" &
" '
" (
%
%
'
$%
'
&
%&
&!
 
&$

%
%#
'
 
'!

!
##
#
$


"
$
&

 
"
   

    

 
!
"
#
$
%
&


Netbeans
 has  more  
number  of  bugs  reported  
per  reporter  on  average,    


Especially  on  
Linux  
and
 Mac  
Proportion of Heavy Reporters
6
& ))1
% '*1
& ',1
% &+1
& %,1
% &-1
& ++1
% (,1
' +.1
% *%1
' (+1
% *,1
% %%1
% *%1
& %%1
& *%1
' %%1
' *%1
( %%1
 &%%"*%%  
*%
%
  
!
!
!
 !
 !
 !


More  people  discovered  
large  amount  of  bugs  -­‐>  the  
IDE  is  less  stable  


The  ra;o  of  reporters  who  
reported  100  to  500  bugs  for  
Netbeans
 is  larger  than  for  
Eclipse  


More  obvious  same  results  
for  the  reporters  reported  
more  than  500  bugs  


Eclipse  


Mac  OS  
gets  the  best  results  


Netbeans  


Windows
 gets  the  best  results  
Eclipse
Netbeans
Eclipse
Netbeans
Severity of Bugs
7
#%)#-
%#$*-
#$'&-
%$'&-
#"($-
%%#"-
"""-
'""-
#"""-
#'""-
$"""-
$'""-
%"""-
%'""-
 



 





Overall  percentage  of  high-­‐
severity  bugs  in  
Netbeans
 
much  higher  than  in  
Eclipse  


Difference  among  the  
opera;ng  systems  not  
significant  
Bug Reopen Rate
8


Eclipse
 has  lower  overall  bug  
reopen  rate  than  
Netbeans
 
(difference  not  significant)  


Eclipse  show  more  resilience  


Eclipse    


Windows
 has  the  lowest  bug  
reopen  rate  and  
Linux
 has  the  
highest  


Netbeans  


Mac    OS
 has  the  lowest  bug  
reopen  rate  and  
Windows
 has  
the  highest
 
Bug Turnaround Time
9
"
!$ %

""

"#
$"
!!%
 
!#"
#
!"





!
"
#
  

 

Windows (Average)
Linux (Average)
Mac (Average)
Windows (Median)
Linux (Median)
Mac (Median)


Bugs  of  
Eclipse
 need  much  
less  ;me  (number  of  days)  
to  be  fixed  compared  to  
bugs  of  
Netbeans  


For  both  IDE’s,  bugs  on  
Windows
 take  slightly  less  
;me  to  be  fixed  and  
Linux
 
ranks  as  the  second  
Conclusion


Eclipse
 
outperforms  
Netbeans
 in  the  given  condi;onal  
comparison  in  terms  of  flexibility,  stability  and  compatability  


Within  each  IDE,  performance  on  different  opera;ng  system  
does  not  have  much  difference    


For  
Eclipse
,  the  bug  data  on  
Mac  OS  
shows  a  slightly  
preferable  result  


Our  findings  suggest  users  of  
Eclipse
 on  
Mac  OS  
have  a  be7er  
experience  in  terms  of  system  stability  


Alterna;ve  explana;ons  possible  


Other  factors  which  our  study  does  not  take  into  account  may  
affect  the  user  experience  
10