Testing as a Service

sunfloweremryologistData Management

Oct 31, 2013 (3 years and 9 months ago)

74 views

CSC Proprietary and Confidential

1


Testing as a Service
-

New
Realities and Perspectives to address Quality
and Agility challenges in BFSI Testing

Amiruddin

Syed Mohammed

CSC Proprietary and Confidential

2


BFSI Test Offerings

Regulatory & Compliance

Integration with Channel Partners / 3
rd

Party Systems

Security


Application / Network / Data

Migrations, Conversions, Consolidations & Legacy
Modernization

Global Adaptations

Data Warehousing / BI

The
Sectoral

Challenge

BFSI Corporate
strategies…

Mergers &

Acquisitions

Innovative

Products

New

Technologies

Market
Concentration
and
Globalization


Sectoral

challenges…..

CSC Proprietary and Confidential

3


The Need : Do More with Less

Business and
Operational Risk

Security, audit and reporting requirements

Functionality, Non
-
functionality, Predictability and

Reliability

Assurance of External & Internal Quality





Lower TCO

Move from CAPEX to OPEX

Predictability of Testing and software costs

Scalable resources and Economies of scale

Eliminate Overhead cost on under
-
used capacity

Standardization through industrialized service delivery



ROI and Cost Control

Market Agility and
Responsiveness


Faster time to market for New products and services

Realize benefits from
Distruptive

and Emerging
technologies ( Cloud, Mobile , etc)

Empower business with modernized applications

New ways to collaborate with customers & partners

New business models



CSC Proprietary and Confidential

4


So What is Testing as a Service (
TaaS
)?

Testing of IT applications ( Custom, Enterprise, Business apps) leveraging
Cloud for virtualized , scalable ,on
-
demand test labs that provide self
-
provisioning and management of multi
-
platform environments. These are similar
to traditional 3
rd
-
party testing services such as dedicated testing centers of
excellence but executed and managed in Cloud based.*


Testing tools


Test scripts


Test standards


The work flow


The standard applications that are being tested (like SAP or Oracle or point solution)


Test metrics


The test environment (Platform, architecture and the applications them selves)

What is
Same….

What is
New….


Complete utility model for platform, test experts and tools


Predictable End
-
to
-
end cost


Access to variety of tools.. In some cases more test coverage because of multiple
tools testing


One stop solution possible for all testing .. Option to change the tools selection, when
not satisfied (Try and use)


Verify architectural / design level


using new generation performance tools


before
going live.

* Adapted from IDC definition of
TaaS


CSC Proprietary and Confidential

5


Overview of ‘ As a Service ‘ from a Testing point of view


Functional Testing
as a
Service


Performance Testing as a
Service


Mobile Testing as a Service


Test Automation as a Service


Security Testing as a Service


.......


Test Environment (Servers / Desktops/
Configurations)on demand to support


New
Develpment

/ Enhancement


Patches / Hot
Foixes



Migrations / Upgrades


ASQ Tools in alternate licensing models


Test Management Tools


Automation tools


Performance Testing tools


LCQM tools


Open Source Tools

Capability
-
as
-
a
-
Service
(CaaS)

Software as a Service (
SaaS
)

Platform
-
as
-
a
-
Service (PaaS)

CaaS

PaaS

SaaS

Testing

CSC Proprietary and Confidential

6


How is
TaaS

different from Traditional Testing Models ?

Labour Arbitrage as key lever



Business Value

+ Cost Reduction
as key lever

Craftsman Approach

Industrialized

Input based pricing

Output / Outcome based pricing

Rigid

Flexible and Scalable on Demand

Testing seen as a tactical activity

Testing seen as a strategic enabler

Limited collaboration with ASQ
partners

High on collaboration with ASQ
partners

Resource ( People ) focus

Services ( Assets) focus

A paradigm market shift underway


from
labour

arbitrage and process
efficiency to service arbitrage and business
assurance

Traditional Testing

TaaS


CSC Proprietary and Confidential

7


Insurance

On
-
Demand

Resourcing





Output Based

Pricing





Service
Performance
Metrics




Global Process
Framework







Reusable Asset
Repository



SHAPE

-

Test Process Management

-
Cloud Enablement

Mobility


Choice of Engagement & Global Delivery Models with alternative Pricing Options

Virtual Teams using Collaboration tools & platforms


Alliances
-

VMWare

, Citrix , IBM Rational, HP Mercury, Segue, Compuware, Work soft, and ITKO



Pay as you
go

Service arbitrage


Ubiquitous Access


Geography independent


Sourced on Demand

Improved utilization


Elastic
Use

scale
-
up / scale
-
down

Enhanced Quality
Faster time to market


TRANSFORM

-

Hybrid
TCoE


-

Web Apps. Perf. Testing

-

Cloud Certification

MANAGE

Industrialized Testing Services

Functional Testing

Non Functional Testing

ERP Testing

Specialized Validation

Key drivers for
testing in cloud

Banking and Financial Services



CLOUD LAB

Testing Offerings

TaaS

in
Cloud for BFSI


SHAPE , TRANSFORM and MANAGE your portfolio


Business Drivers


Pressure to reduce operational spending


Faster time to market


Emergence of global workforce


Meet dynamic resource requirements


Move towards variable cost structure for
testing services and even ASQ tools

IT Drivers


Need to support strategic initiatives


Multi
-
site delivery and 24X7 operations


Focus on first
-
time
-
right


High incidence of production issues and
higher cost of rework


Keep pace with technology

CSC Proprietary and Confidential

8


Platforms

Windows (Multilingual,
Multi CPUs)

Linux (Red hat,
Linux, Debian)

MS
-
SQL. Oracle, DB2,
Informix,
MySQL
,
Teradata

Sun Solaris

Elastic servers
(Tomcat, My
SQL
combinations)


Mobile Platform
simulators

Borland ES, Cold
fusion, Tomcat,
Web logic, Web
Sphere, Web
Application server
(SAP), ATG
Dynamo, JBOSS

Tools
Sandbox

Apps

& Services

Client / Server

Enterprise Applications


SAP, Oracle,
Cadence, PTC, Sugar
CRM

Web
Applications

Service

Virtualization

SAAS (Software as a Service)

Functional Testing

Non Functional Testing

Mobile Testing

Cloud Certification

TaaS

Ecosystem


A snapshot


CSC Proprietary and Confidential

9


Customer

Test Requirements &
Application

Components

TaaS

in Cloud

FTP /
URL / VPN

Cloud lab

Database servers

Web Server

Application Servers

Application Under Test

Automated Software Quality Tools

Infrastructure
Stabilization

Test Strategy &
Planning

Test Execution

Test Summary
Reports

Certify
Application

Customer requests
Testing from
Provider

Provisioning /
Scheduling of Tests

Provider conducts
Testing

Provider publishes
Test Results &
Reports

Collaboration

Customer
Sign
-
off

Cloud
Orchestration

Provider

Customer

Provider
&
Customer

Mobile Simulators

Service virtualization

Provider

TaaS



Delivery Model



CSC Proprietary and Confidential

10


Traditional Testing Vs
TaaS

Comparisons

Traditional

Lab

Test

Planning

Test Case/Data

Development

Configure

Environment

Test

Execution

Resolve

Defects

Dramatic
reduction in test cycle time

Significant reduction
in total cost of operation

Test

Planning

Test Case/Data

Development

Configure

Environment

Test

Execution

Resolve

Defects

Config. 1

Config. 2

TaaS



Cloud Lab

Test Pass 1

Test Pass 2

Config. 1

Config. 2

CSC Proprietary and Confidential

11


The Challenge



Concerns on Security in Cloud



Lack of Test Environment management expertise



In efficient test automation



Beyond Testing


complimentary services ( ADM etc)



Evaluating the right tools



Lifecycle quality management



Integration with non
-
virtualizable

components



Additional Skills for Testers

CSC Proprietary and Confidential

12


Critical factors an enterprise should consider while evaluating
test vendors for
TaaS


TaaS

is evolving


hence Providers should offer customers flexible
buying options


discrete
vs

bundled


High Value Test assets owned by the provider


reusable assets,
accelerators and frameworks


Technical resource expertise in test automation


Lifecycle quality management tools and capabilities


Experience managing Security of data and
TaaS

environment


SLA based delivery


Automatic backup and recovery


Dashboards and tracking tools


Larger portfolio of offerings


benefit from ADM , SOA, Security offerings



CSC Proprietary and Confidential

13


Building Roadmap Towards
TaaS


Phase 1

Phase 2

Phase 3

Cloud Testing Strategy

Pilot first application on Cloud

Cloud Testing Services


Cloud Testing assessment


Detailed transition Plan identifying priority applications


Identify test types


functional, automation ,
performance, security ….


Set up Cloud environment


Carry out Proof of Concept


Enhance Cloud Testing framework based on Pilot
results



Replicate for other applications


Optimize tools and licenses


Extend to other testing types


Measurement & Ongoing Improvements


Shape

Transform

Manage

CSC Proprietary and Confidential

14