Ignite TAAS and beyond - UMdrive

possehastyΜηχανική

5 Νοε 2013 (πριν από 4 χρόνια και 4 μέρες)

85 εμφανίσεις

Deepak Puri

Testing


What has been attempted

Engagement
Models with
service
providers

Test
Organisation

People

Business

process /

domains

CIR,

Energy

Business

process /

domains

HealthCare

Life Science

Business

process /

domains

Banking

Capital Mkt.

Business

process /

domains

Insurance

Business

process /

domains

Transportation

Airlines

Business

process /

domains

CM&E

Business

process /

domains

Manufacturing

Industry Verticals

Tech

Portal / ECM

BPM

SOA

ERP /SAP

BI/DW

CRM

Data Engineering

Non
-
Func

Automation
Enterprise wide?

Performance
Engineering?

Test Process

Test Environment

L8N & I18N

Usability

Cloud Testing

Requirement
Analysis

Test Estimation

Agile Basesd
Testing

Test Case Optimise

Migration Testing

Test Reporting

Defect Management

Reliability
Prediction

Test
Data
Management

Games

Security
Engineering
?

Test Techniques

Test Process
Consulting

Maturity models

Metrics

Value

Process

Technology

Future of Testing

Next:
TAAS?

1.

Insourcing


Decentralised


Project Based


Centralised


Test CoE

2. Outsourcing


Staff Augmentation (L1)


Cosourcing (L2)


Project based (L3)


Managed Services (L4)

Understanding TAAS


Web Scan

Wikipedia

-

Testing as a Service

(
TaaS
, typically pronounced '
tass
')
is a model of software testing whereby a provider undertakes the
activity of
software testing

applications/solutions for customers as a
service on demand. …involves the on
-
demand test execution of well
-
defined suites of test material, generally on an outsourced basis.

Testing as a service is …on demand service … ”pay as you go” service.

-

A Leading service provider site

IEEE article on TAAS in Cloud
-

Testing
-
as
-
a
-
service (TaaS) is a new
model to provide testing capabilities to end users. Users save the cost
of complicated maintenance and upgrade effort, and service providers
can upgrade their services without impact on the end
-
users…

Testing as a service (TAAS)

Is It:



Packaging of
Testing
service with Tools?



Automation of test process?



Testing in cloud?




Crowdsourcing?

Testing as a service (TAAS)

But Most agree that TAAS is


Shared
Services
delivery model


Pay
per
by drink and not by Glass


Standardised
,
Repeatable services.

Service Dimensions

Core

IT services


as a Self service

Enabling

Peripheral

IT Services

Enhancing

Peripheral

IT Services

Exploitive

Context

(
Services
)

Exploitive

Context

(
Products
)

Context

IT Services

A taxonomy of IT Services

(
Kaitovarra

and
Nurminen
, 2003)

e.g. Test Automation

Core

IT services



Automation Framework



Automation of
Regression test suite &



Test execution

Enabling



Connectivity
to outsourcer.



Security.



DR

Enhancing



Training on Test
Framework.



Integration with
QC

Exploitive



Regression testing



Test Consultancy

Exploitive


Test Tools

Context

IT Services

A taxonomy of IT Services

(
Kaitovarra

and
Nurminen
, 2003)

IT Professional Service trends

To move from highly customised IT services to Productisation of services.

Products Vs Services

Case of Photocopier or Document Management

Why Productise?

Client Benefits

Service provider Benefits

Low perceived risk of intangible services

Increased Credibility of services offered

Consistent delivery of services

Standardisation and repeatable core
components

Lower TCO. Increased predictability

DeCaptilisation.

Increased profitability. All resources in
shared services, including tools.

Better value extracted from outsourcing

Differentiation through Productisation.
Continuous investment in core services.

Simplify the contract.

Sales Effectiveness increased

Simplify the Consumption of services

Better client Satisfaction

Easy to compare

Easy to define. Documented knowledge

Faster time to market.

Faster time to procure.

Pitfall of Service Productisation?

Scare resources and lack of know how

Danger of simplifying too much

Knowledge sharing


not without friction

Imitation by competitors

Client may not be willing to pay high price

TAAS


Conceptual Model

TAAS

Engine

Customer
Interface

Service 3

Service 2

Testing
Framewor
k

In house
Tools /

External Tools

Test

Analyst

Test

Process

Internal Service
Management

Web

Automation Offering

Perf .Test

Web/ERP

Performance Offering

Functional Test
Offering

Commercial
Models

SLAs

Manual Testing

Services

Service
n


HAAS/

Cloud

Demand Management

Customer
1

Customer
2

Customer …
n

Service Catalogue for business

Service Catalogue for Operations

Customer Service
Management

Test
Assets

Test
Assets

Test
Assets

Test
Assets

TAAS
-

Crowdsourcing

TAAS

Engine

Customer
Interface

Service 3

Service 2

Testing
Framewor
k

In house
Tools /

External Tools

Test

Analyst

Test

Process

Internal Service
Management

Web

Automation Offering

Perf .Test

Web/ERP

Performance Offering

Functional Test
Offering

Commercial
Models

SLAs

Manual Testing

Services

Service
n


HAAS/

Cloud

Demand Management

Customer
1

Customer
2

Customer …
n

Service Catalogue for business

Service Catalogue for Operations

Customer Service
Management

Layer
Provided
by tester

Online
collaboration

limited to
consumer market
applications?

Pay per
defect

Best effort

Test
Assets

Test
Assets

Test
Assets

Test
Assets

Owned by
Testers

TAAS
-

Service Packaging

TAAS

Engine

Customer
Interface

Service 3

Service 2

Testing
Framewor
k

In house
Tools /

External Tools

Test

Analyst

Test

Process

Internal Service
Management

Web

Automation Offering

Perf .Test

Web/ERP

Performance Offering

Functional Test
Offering

Commercial
Models

SLAs

Manual Testing

Service
Packages

Service
n


HAAS/

Cloud

Demand Management

Customer
1

Customer
2

Customer …
n

Service Catalogue for business

Service Catalogue for Operations

Customer Service
Management

Owned by
service
provider

Global
Delivery
Model

Mix of
standardised and
non standardised
services

Based on
Test
Points

(inc tools)

Defined
per
project

Owned by
service provider.
Continuous
Improvement

Test
Assets

Test
Assets

Test
Assets

Test
Assets

Limited
sharing of
resources

Activities and
deliverables
defined per project

TAAS
-

Service Products

Digitizing the world

TAAS

Engine

Customer
Interface

Service 3

Service 2

Testing
Framewor
k

In house
Tools /

External Tools

Test

Analyst

Test

Process

Internal Service
Management

Web

Automation Offering

Perf .Test

Web/ERP

Performance Offering

Functional Test
Offering

Commercial
Models

SLAs

Manual Testing

Service
Products

Service
n


HAAS/

Cloud

Demand Management

Customer
1

Customer
2

Service Catalogue for business

Service Catalogue for Operations

Customer Service
Management

Global
Delivery
Model

Move towards
standardised
services

Fixed
price per
product

Pre
-
defined

Test
Assets

Test
Assets

Test
Assets

Test
Assets

Owned by
service
provider

High
sharing of
resources

Owned by
service provider.
Continuous
Improvement

Activities and
deliverables
Predefined

Customer …
n

Possible solution Map

Testing Automation

AT400

Time

AT 200/400

E

E

E

E

Automated Test Execution
product

2 week Release


AT
100/200/400

AT
100/200/300?

QTP to
Selenium ?


ONSITE /
OFFSHORE?


Additional
Automation?


Additional
Automation?


Automation
Journey

Jan 2011

Jun 2011

Dec 2011

0

400

800

1100

Manual
Testing

Manual
Testing

Manual
Testing

Manual
Testing

Automation TAAS

Product

Legends

Auto TC

Manual
Testing

Q&A


Thank You

Service

What is a Service?


Defined entry criteria


Defined exit criteria


Define activities


Defined deliverables


Defined commercials


Defined R&R


Defined scope and dependencies.

The service “Tree”

(Johns, N


1999)

What happens if this “defined” becomes “Predefined”

Key Characteristics of IT Professional Services



Intangible
-

Some IT services are more tangible than others



Reuse



Ownership is not transferred.



Co
-
innovation

-

Customer are part (co producers) of IT services.



Global Delivery
-

Location independent but time dependent



Standardisation and Reuse
-

Relatively homogeneous
-

can be stored
/ quality controlled.



Creditability

-

Cannot be easily demonstrated before procuring.



What is more important is their
value

to customers.

TAAS


Which model is the best?

Crowdsourcing

Service packaging

Service products

1.
Consumer market
Applications

2.
Exploratory Testing at
least cost

3.
Application has to be
reasonably stable (tested)
before offering for
crowdsourcing.


1.
Scope
-

Any kind of
testing including
progression testing.

2.
Can Include test asset,
tools, any cloud based
assets.

3.
Can accommodate high
level of requirement
volatility but passes

the
commercial risk to client.

4.
Predictable outcomes at
variable cost.

1.
Scope
-

Any testing which
has large standardised

components, e.g. test
automation, SAP Testing.

2.
Can Include test asset,
tools, any cloud based
assets.

3.
Can accommodate low
level of requirement
volatility and DONOT pass

the commercial risk.

4.
Predictable outcomes at
fixed predictable cost.

Future of Testing


Insourcing


Outsourcing


Crowdsourcing
aka TAAS


Testsourcing

James Whittaker
-

Google

Test Case as service product.