SCTM 2010 R2 / HP ALM 11 Competitive Analysis

horsescurrishInternet and Web Development

Jul 30, 2012 (5 years and 3 months ago)

881 views

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
1


Test
Management Competitive Analysis HP ALM 11

This document is confidential and must not be spread outside MicroFocus
.

Inhaltsverzeichnis

Introduction

................................
................................
................................
................................
.............

2

Application Lifecycle Management Comparison

................................
................................
.....................

2

HP ALM 11

................................
................................
................................
................................
...........

2

SCTM

................................
................................
................................
................................
....................

2

Architecture Overview

................................
................................
................................
............................

3

HP ALM 1
1

................................
................................
................................
................................
...........

4

SCTM

................................
................................
................................
................................
....................

4

Editions

................................
................................
................................
................................
....................

4

HP ALM 11

................................
................................
................................
................................
...........

4

SCTM

................................
................................
................................
................................
....................

5

Functional Comparison
................................
................................
................................
............................

6

Competitive Screenshots

................................
................................
................................
.......................

10

Database Management

................................
................................
................................
.....................

10

HP Specific


License Management

................................
................................
................................
...

11

Configure Mail/SMTP

................................
................................
................................
........................

11

Configure Product/Version/Build/Release

................................
................................
........................

11

Project List

................................
................................
................................
................................
.........

12

Project Management


Create Project

................................
................................
..............................

12

HP Specific

................................
................................
................................
................................
.........

12

Requirement Hierarchy

................................
................................
................................
.....................

12

Requirements Description with Text, Table and Pictures

................................
................................
.

13

Requirement Attributes with Choice Field

................................
................................
........................

13

Requirements Report

................................
................................
................................
........................

13

Requirements Summary

................................
................................
................................
....................

14

Test Case Overview

................................
................................
................................
...........................

14

Test case Editing

................................
................................
................................
................................

14

Test Step
Editing

................................
................................
................................
................................

14

Test Case Run Overview

................................
................................
................................
....................

15

Test Case / Requirements Linking

................................
................................
................................
.....

15

Test Execution Overview

................................
................................
................................
...................

15

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
2


Test Case to Test Execution Assignment

................................
................................
...........................

15

Test Execution Scheduler

................................
................................
................................
..................

16

Test Execution


manual Tester and Execution Server Assignment

................................
.................

16

Test Execution Dependencies

................................
................................
................................
...........

16

Test Execution Runs Overview

................................
................................
................................
..........

16

Online Test Execution
-

Start

................................
................................
................................
.............

17

Online Test Execution


Run

................................
................................
................................
..............

17

Offl
ine Test Execution Run

................................
................................
................................
................

17

Activity List

................................
................................
................................
................................
........

18

Report


Test Execution Comparison

................................
................................
................................

18

Report


Test Definition Status Overview

................................
................................
.........................

18

Report


Test Comparison between Builds

................................
................................
.......................

19

Report


Status of Test cases

................................
................................
................................
............

19

Summary

................................
................................
................................
................................
...............

19

Functionalities which should be
stressed in a competitive situation:

................................
..................

19

Functionalities which should not be stressed in a competitive situation:

................................
............

19


Introduction

Hewlett Packard released in autumn 2010 their new ALM Suite 11.
While HP Quality Center
was
always the main competitor
against

SCTM, it is interesting what feature they added and where HP is
better than SCTM and where SCTM
has unique features to beat HP.

SCTM still has the broader
language (HP still only english) and browser (HP still Internet Explorer only) support. HP added a
c
omplete requirements management system to compete against Caliber and Doors.

HP has still 3
different editions of Quality Center, while SCTM is an all
-
in
-
one solution.

Application Lifecycle Management Comparison

This is a comparison of how both solutions
see the end
-
to
-
end testing and covers all the modules
included in the solution.

HP ALM 11


SCTM

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
3



Architecture Overview

This is an overview of the architecture of both solutions.

Both solutions have load balancing for
delivering the maximum speed. Additionally SCTM has a keyword driven load balancer for the
execution

of automated tests, which is not covered in this figure.

Silk Central Test Manager

Requirem
ents

Managem
ent

Test

Planning

Test

Execution

Defect

Tracking

Reporting

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
4


HP ALM 11


SCTM


Editions

HP ALM 11

HP Application Lifecycle Management (ALM) is software solution platform that has been designed for
managing the complete application Lifecycle from Requiremen
t
inception to Release rollout.

ALM is available in various editions, which provide subsets of ALM functionality:



HP quality Center Starter Edition



HP Quality Center Enterprise Edition

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
5




HP ALM Performance Center Edition


HP ALM Edition

Description

HP ALM

Complete ALM functionality. Designed for mature
organizations and Centers of excellence
(CoE)
involved with
managing enterprise releases

HP Quality Center Starter Edition

For quality management teams managing small releases

HP Quality Center Enterprise E
dition

For quality management teams managing medium to large
releases

HP ALM Performance Center Edition

For managing all aspects of large
-
scale performance testing
projects


The following table indicates the availability of ALM functionality according to

editions.

F
unctionality

HP ALM

HP Quality Center
Starter Edition

HP Quality
Center Enterprise
Edition

HP ALM
Performance Center

Licensing

Yes

Yes
(Partial)

Yes

Yes

Modules

Yes

Yes
(some exclusions)

Yes

Yes
(some exclusions)

Point and Click
Installation

No

Yes

No

No

Release Management

Yes

No

Yes

Yes

Project Planning and

Tracking (PPT) Releases

Yes

No

No

No

Multiple Req.Types

Yes

No

Yes

Yes

Req. to Req. Traceability

Yes

No

Yes

Yes

Risk
-
Based Quality
Management

Yes

No

Yes

Yes

Business Models Module

Yes

No

Yes

No

Test Resources

Yes

Yes

Yes

Yes
(Partial)

HP Sprinter

Yes

No

Yes

No

Versioning

Yes

Yes
(Single Entity)

Yes

Yes

Sharing Requirements and
Tests

Yes

No

No

Yes

Sharing Defects

Yes

No

No

Yes

Cross project

customization

Yes

No

No

Yes

Cross Project reporting

Yes

No

No

Yes
(Partial)

Excel Reporting

Yes

Yes

Yes

Yes
(Partial)

Business Process Testing

Yes

Yes
(Up to Five)

Yes

No

Extra Options

Yes

Yes

Yes

Yes

Upgrading Editions

--


Yes

Yes

Yes

SCTM

SCTM
is an all
-
in
-
one test solution and
has only one edition, where all features are included

and
enabled
.

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
6


Functional Comparison

This table makes a very extensive feature comparison between both products.
Non existing features
in one product are marked with red background. Feature marked with green background indicates
that this feature is significantly better realized in one product. This means, green back grounded
features in
SCTM
and red back grounded fea
tures in HP
can
be used to win in competitive situations

against HP.

Functionality

HP ALM 11 RM

SCTM 2010 R2

SolMan Integration

Setup

What is synced?

















Incident Management

More a kind of Import Function

Complex customization

Only Business
Scenarios

and
Process steps with attached
Test Objects or Documents

will be synced

Changes in QC

overwritten
without notice

Implicit warning in the setup
that changes will be
overwritten.


HP connector only using
existing containers of SolMan

(If they are

empty below
process steps nothing will be
synced nor even notified



Complex setup with mapping of

e
ach individual field

Two update and sync flagging changes

Out of the box

Everything under Business Scenarios

We link docs don´t sync content itself






We

built additional Tabs and
containers inside SolMan which make
every change from SCTM visible in
SolMan even if the structure in the
standard environment is not available






We jump Realtime into SAP´s incident
mgmnt. Update of Status Change
Realtime in
SCTM



HP ALM 11 RM

SCTM 2010 R2

Server / Client / Database



Server

JBoss
, WebLogic, WebSphere
(App Server)

JBoss,
WebLogic,
Apache
, IIS

(Web Server)

Windows 2003 Server

Unix (Sun, Linux, HP
-
UX)

Tomcat, IIS

Windows 2003
, 2008, 2008R2

Server

Client

Internet Explorer

7,8

with
ActiveX

Internet Explorer 6,7,8

Firefox 3.5

Any other browser

Runs also on Linux or Apple
Browsers

Minimum Server Configuration



CPU : Quadcore AMD64
processor or equivalent



Memory (RAM): 4 GB



Free Disk Space: 8 GB




CPU :
Pentium 4 or
equivalent cpu



Memory (RAM): 2 GB



Free Disk Space: 10 GB


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
7


Functionality

HP ALM 11 RM

SCTM 2010 R2

Minimum Client Configuration



CPU :
Core2Duo 1.6GHz

processor or equivalent



Memory (RAM):
2

GB



Free Disk Space:
2

GB




CPU : Pentium 4 or
equivalent cpu



Memory (RAM):
1

GB



Free Disk
Space: 1 GB


Database

SQL Server, Oracle

SQL Server, Oracle

Client GUI

Web, ActiveX, Internet Explorer

Pure HTML
Web Client

GUI Language

English

English, German,
Japanese

C
haracter Set

no cyrillic after check
-
in

UTF8

Character Set Description

UTF8

UTF8

Security Handling



Security Summary

Project Users

Create, Update, Delete on
Requirements
, Test Cases

and
Attributes
,
Data Hiding per
Filter

Per
Project

different roles

Security Profiles

Group Security

Group and role based

User Definition

X

X

Group Definition

X

X

Role

Definition

Not Available

X

Account Restrictions

X, Deactivation

X, Disable, Change Password

License Management

Internal

Silk Meter

Concurrent Licensing

???

X

Named Licensing

Per Module

X

User Monitoring

Logged in/out time,
Statistics

X
, through SilkMeter




Attribute Handling



System Attributes

all are changeab
le

X

User Defined Attributes

Number, String, Lookup List,
User List, Date, Hierarchy List

Boolean, Date, Integer,
Selection List
, depends on type
Requirement/Testcase

UDA Default

???

X

(Inheritance)

UDA Database wide

X

Not available

Multiedit Attributes

X, mark in Grid, then new
window for assigning

X, for Test Cases




Project Management



Create Domains

X,
HP has a domain model

Not available

Create
/Change/Delete P
roject

X

X

Create
/Delete

Baseline

Not available

X

Activ
a
te /
Deactivat
e

projects

Not available

X

Copy Projects

X

X

Project Template

X

X

Promote Repository Cleanup

X

Not available

Set a Quota of user connections

X

Not
available

Add
/Assign

user to project
from the user list

X

X

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
8


Functionality

HP ALM 11 RM

SCTM 2010 R2

Import project from a project
file

X

Not available

Restore project

X

Not available

Upgrade
,
Verify
,
Repair Project

X

Not available

Assign user groups to a project

X

X




User/Group/Role
Mngmt



Add/Change/Delete User

X

X

Add/Change/Delete Group

X

X

Add/Change/Delete Role

Not available

X

Activate/Deactivate User

X

X

Manage Administrators

X

X

Mixed Authentification

X

X

LDAP Authentification

X

X

Import LDAP user by FILTER

X

Not
available

Change / Set Password

X

X

Set Time Zone

Not available

X

Set automatic Deactivation
Date

X

Not available

Requirement
sManagement



Requirement ID

N
umber

Number

Requirement Name

Text

Text

Requirement Description

RichText Editor

HTML

Editor

Description Text

X

X

Description Picture

X (only
RichText Editor
)

X

Description Table

X (only
RichText Editor
)

X

Description Links

X (only
RichText Editor
)

X

Requirements

Import

Word, Excel A
ddins

Word

Requirements Export

Word, Excel Addins

BIRT Report,
Excel

Requirements Hierarchy

X

X

Requirement Versioning

X

Not available

Requirement Compare

X

Not available

Requirement History

X

X

Requirement Search

Full Text Search

Through reporting

Requirement Copy

X

X

Requirement Move

Drag and Drop

Cut and
Paste

Requirements Filtering

Personal, Favorites

Save
d

Filters

Requirements Reuse

Shared Libraries

Copy and Paste

Attachments

X

X

Requirements
Grid

X

Not available

Requirements Matrix

X

Not available

Requirements Traceability

X

Not available

Requirements Baselining

X

Through Project Baseline

Synchronize with external
Requirements Management
Tools

???

CaliberRM, CaliberRDM, IBM
RequisitePro, IBM Telelogic
Doors




SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
9


Functionality

HP ALM 11 RM

SCTM 2010 R2

Test Case handling



Test Case
Description

Text, Table, Pictures
(only
RichText Editor
)

Text, Table, Pictures

Test Case Import

Word, Excel A
ddins

Excel

Test Case

Export

Word, Excel Addins

BIRT Report, Excel

Test Case

Hierarchy

X

X

Test Case

History

X

X

Test Case

Versioning

X

X

Test Case

Search

Full Text Search

Through
reporting

Test Case

Copy

X

X

Test Case

Move

Drag and Drop

Cut and Paste

Test Case

Filtering

Personal, Favorites

Save
d

Filters

Test Case

Reuse

Shared Libraries

Shared Libraries

Manual Test Steps


Title, Action Description, Result

Action Description


Text, Table, Pictures

Test case Screenshots

Easy to use

X

Test case Videos


X

Data driven Test cases


X (for manual and automated
tests)

Test case Parameters


X (for manual and automated
tests)

Test case Attachments


Files or Links

Link Test case to
Requirements


X

Link Issues to
Test cases


X

Direct Impact Analysis TC
-
REQ


X

Direct Impact Analysis TC
-
ISSUE


X

Test case execution history


X




Test Execution handling



Test Execution
Description


Text, Table, Pictures

Test Execution

Hierarchy


X

Test Execution

History


X

Test Execution

Search

Full Text Search

Through reporting

Test Execution

Copy

X

X

Test Execution

Move

Drag and Drop

Cut and Paste

Test Execution

Filtering

Personal, Favorites

Save
d

Filters

Test Execution to
Case linking


X (m:n)

Direct Impact Analysis TE
-
ISSUE


X

Direct Impact Analysis TE
-
REQ


X

Test Execution Parameters


X

Configuration Execution


X

Test Execution Setup


X

Test Execution Dependency


X

Test Execution Scheduler


X

Tester Assignment


X

Execution
Server Assignment


X (load balancing through
keyword driven execution)

SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
10


Functionality

HP ALM 11 RM

SCTM 2010 R2

End Notification


X

Test Execution Run History


X

Manual Test Execution in
Webclient


X

Offline Client for Execution


X

Issue Creation from Execution


X













Offline
Client









Issue Management









Report Generation



Reporting functionality

X, very extensive reports with
analysis,
diagrams

X
,
completely
free configurable
extensive reporting with
analysis, diagrams

Enhanced Reporting

X, simple to use

X
(
BIRT
)




Other Functionality



Mail

Highly Configurabable

SMTP, Configurable

Single Sign
-
on

No, LDAP

No, LDAP




API



Webservice

No

X

Competitive Screenshots

Database Management


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
11


HP Specific


License
Management


Configure Mail/SMTP


Configure Product/Version/Build/Release


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
12


Project List


Project Management


Create Project


HP Specific


Requirement Hierarchy


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
13


Requirements Description with Text, Table and Pictures






R
equirement Attributes with
Choice
Field


Requirements Report


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
14


Requirements Summary


Test Case Overview


Test case Editing


Test Step Editing


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
15


Test Case Run Overview


Test Case / Requirements Linking


Test Execution Overview


Test Case to Test Execution Assignment


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
16


Test Execution Scheduler


Test Execution


manual Tester and Execution Server Assignment


Test Execution Dependencies


Test
Execution Runs Overview


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
17


Online Test Execution
-

Start


Online Test Execution


Run


Offline Test Execution Run



SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
18


Activity List


Report



Test Execution Comparison


Report


Test Definition Status Overview


SCTM 2010 R2

/ HP ALM 11 Competitive Analysis


Confidential

page
19


Report


Test Comparison between Builds


Report


Status of Test cases


Summary

HP ALM 11 does have new functionalities


Functionalities which should be stressed in a competitive situation:



Different languages and a complete UTF8 handling for a worldwide use



SCTM is p
ure HTML (AJAX), different
Browsers supported
, HP is IE specific



Reporting

in SCTM

Functionalities which should
not
be stressed in a competitive
situation:



Requirements Management Features



E
-
Mail notification features (HP is here highly configurable)



User defined attributes with
hierarchy