IBM Software - Rational standard template for internal and ... - IAAS

hastywittedmarriedInternet και Εφαρμογές Web

8 Δεκ 2013 (πριν από 3 χρόνια και 10 μήνες)

87 εμφανίσεις

© 2013 IBM Corporation

DevOps

Trends & Directions


DevOps | IBM




Daniel Berg

Chief Architect,
DevOps

Tools & Strategy

danberg@us.ibm.com

@
dancberg

© 2013 IBM Corporation

2

Software delivery

2

Mobile

Modern workforce

expects constantly

updated software to

connect to enterprise
systems

Intelligent/

Connected Systems

Software component in
smart products driving
increased value and
differentiation

Big Data

Insights on new products by
more efficiently interpreting
massive quantities of data

Cloud

Demand for apps requires fast,
scalable environments for dev

and test, as well as production

Instrumented Products

Industry requirements demand
faster response to regulations

and standards, with traceability
and quality

Social Business

Broader set of stakeholders
collaborates to deliver
continuous innovation

and value

Software delivery is at the heart of today’s top technology trends

© 2013 IBM Corporation

The New Era of Systems of Interaction

Cloud
-
based

Services

Systems of Record

CRM

HR

DB

ERP

Internet of Things

Systems of Engagement

200 Billion

Physical assets with IT
intelligence

6 Billion

SmartPhones worldwide

60,000

Cyber attacks every day

450 Billion

Business transactions / day
over the Internet by 2020

3

© 2013 IBM Corporation

4

And a lack of continuous delivery impacts the entire business

Costly, error prone
manual processes and
efforts to deliver software
across an enterprise

CHALLENGES


Upgrade risk
due to
managing multiple application
configurations and versions
across servers


Slow

deployment

to development and test
environments leave teams
waiting and unproductive


CHALLENGES

Operations/

Production

Development/

Test

Customers

Business

Owners

Software glitch costs
trading firm Knight
Capital $440 million
in 45 minutes

A bad software upgrade

at RBS Bank left

millions

unable to access
money for four days

New Zealand’s biggest phone company,
Telecom paid out
$2.7 million
to some
47,000 customers who were
overcharged
after a software glitch

© 2013 IBM Corporation

Common Deployment problems

5

© 2013 IBM Corporation

New economics of IT
fuels investments in

innovation

Innovation drives
need for continuous
IT

optimization

Optimization


Innovation

Next Generation

of Hybrid

Architectures


Don

t

be

afraid

to

make

mistakes,

just

be

afraid

of

not

learning

from

them
.




Thomas

Edison


Balance optimization with innovation to enable new services

6

© 2013 IBM Corporation

Organizations that effectively leverage software innovation
outperform their competitors...
yet few are able to deliver it effectively

86
%

of companies believe software delivery

is important or critical

25
%

leverage software delivery effectively today

But only…

Source: “The Software Edge: How effective software development drives competitive advantage,” IBM Institute of Business Value
, M
arch 2013

69
%

outperform

those who don’t

of those
who

leverage software

delivery today

© 2013 IBM Corporation

Embrace a DevOps Approach

An enterprise capability for continuous software delivery that
enables clients to seize market opportunities and reduce time to
customer feedback

DevOps Lifecycle

Continuous Innovation, Feedback and Improvements

Operations/Production

Development/Test

Customers

Business Owners

8

© 2013 IBM Corporation

Business Benefit

9

Speed
!


© 2013 IBM Corporation

Agility


10

Business Benefit

© 2013 IBM Corporation





Overcome obstacles

11

Business Benefit

© 2013 IBM Corporation

Business Benefit

12

© 2013 IBM Corporation

13

Business Benefit

© 2013 IBM Corporation

Reduced Risk

14

Business Benefit

© 2013 IBM Corporation

Reduce Costs

15

Business Benefit

© 2013 IBM Corporation

Overhead and
Rework

Valuable
Work


80
%

20
%


60
%

40
%

Removing Waste

DevOps shares ideas with Lean such as the removal of waste from
business processes

Waste of overproduction

Waste of time and resources waiting

Waste of processes themselves (overhead)

Waste of poor quality products


16

© 2013 IBM Corporation


William
Deming



American
statistician


Major influencer of Japanese manufacturing and
business


Famous for
Plan
-
Do
-
Check
-
Act cycle
(Deming
Cycle)


I like “Adjust” versus “Act”


PDCA cycles found in
DevOps

17

William Edwards
Deming

Deming Cycles and
DevOps

© 2013 IBM Corporation

DevOps

Principles and Values

Develop and test against a production
-
like
environments


Iterative and frequent deployments using
repeatable and reliable processes


Continuously validate operational quality
characteristics


Amplified feedback loop drives
improvements

18

People

Process

Technology

© 2013 IBM Corporation

Examples of
DevOps &
continuous delivery

Release automation
at
etsy

Release automation
at
flipkart

19

© 2013 IBM Corporation

Design Philosophy:


Simplicity


Optimize for operational burden


Continuous updates with continuous availability


Instrument everything

Development Philosophy:


Extensive code reviews, unit and functional tests


Keep it DRY (Don’t Repeat Yourself)


Loose coupling using notification/signals


Do most work in Python; C when necessary


Extensive monitoring

2 years, 13 staff (development + ops)

25 K Users

+1M Users (single day)

50M+ Users

14M+ Users

Business Impact


Solution evolved & changed with the business


Architecture re
-
evaluated constantly in relation to business goals


Progressive composition of services


Majority of development focus on creating business value

Instagram



Design Philosophy and Evolution



Python


Django


CouchDB


Git



Traditional Service


Provider


Scale issues


Workload optimized monitoring,
tuning, database


Apache
Solr



PGFouine
,
Dogslow



Gearman
,
Node2dm



Nginx


Postgres
/
Redis


Repmgr


Pgbouncer




Munin
,
statsd


Amazon EC2, CDN, ELB, S3

20

© 2013 IBM Corporation

Design Philosophy
Highlights
:


Continuous delivering & deployment


automating as much
of Ops as possible


Instrument everything


Development Philosophy Highlights:


Small teams < 10 folks per project


Developed
ChaosMonkey

tool to ensure all services
incorporated recovery oriented computing capabilities


i.e.
random failures injected, no single point of failure


Contribute back to open source


Business Impact


Solution
continuously evolving
with the
business


Small teams focused more on creating business value


Progressive composition of services



Netflix


Scaling to meet demand

21

© 2013 IBM Corporation

Risk Calculus for Releases

22

Sources of Defects

R(s)

R(l)

Code

1

3

Configuration

1

3

Complexity

1

12

TOTAL

3

18

Features (N)

3

9

R(l)

R(s)

N

N

2

2

Relationships

Small changes,
delivered more
frequently can reduce
risk
and improve quality

© 2013 IBM Corporation

DevOps Adoption Paths

23

Continuous

Monitoring

Collaborative
Development

Continuous Release
and Deployment

Continuous

Feedback and
Optimization

Continuous

Business Planning

Continuous

Testing

Monitor

& Optimize

Develop

&Test

Release

& Deploy

Plan

& Measure

Continuous

Feedback

People

Process

Technology

© 2013 IBM Corporation

Application Release Management

Cloud Provisioning

Application Deployment Automation

A Delivery Pipeline of Capabilities

Driving continuous delivery of small, incremental changes with feedback

Line of
Business

24

© 2013 IBM Corporation

Line of
Business

IBM
UrbanCode
Build

Delivery Pipeline capabilities
-

Tools

Incrementally adopt when/if needed

Rational Team Concert

SmartCloud Application
Performance
Management

Rational Focal Point

Rational Requirements Composer

SmartCloud Orchestrator

IBM Pure Application System

IBM
UrbanCode
Deploy

IBM
UrbanCode

Release

Rational Quality Manager

Rational Test Workbench

Rational Test Virtualization Server

Jenkins

InfoSphere

Optim Test Data Management

© 2013 IBM Corporation

Systems of Engagement

Systems of Record

Cloud

Develop

Test

Release

Rapid deployments

Transactional systems or packaged
apps

Production

Environment

AppStore

Integration

Develop

Test

Frequent deployments

Few deployments

Release

New DevOps solutions for
Systems of Interaction

Activities across multi
-
tier app delivery moving at different pace need to be carefully coordinated

© 2013 IBM Corporation

Moving towards production

Actual Component

Virtualized Component

Units are introduced into the continuous integration
cycle in a prioritised, controlled fashion


Units not yet built can be simulated as part of a
production
-
like environment

Incremental Integration
Testing

Enable testing early and often with virtualized services

27

©
2013
IBM Corporation

Faster, repeatable, reliable deployment processes with cloud

SCM

Build Automation

QA

PROD

Provision platform

Execute application
deployment and
manage settings
across environments

Patch/update

Publish build

Pull
changes

SmartCloud Orchestrator

Environments

Deploy early and
often to ensure
higher quality and
faster releases
using repeatable,
reliable, and
managed
automation

DEV

DEV

DEV

DEV

IBM PureApplication System

IBM
UrbanCode
Deploy

Cloud Provisioning

Deploy Automation

Platform Config Management

© 2013 IBM Corporation

Workload deployments to the cloud

Compute | Storage

Packaged Software

Application

Middleware

Compute | Storage

Packaged Software

Middleware

Network

Cloud Management

Infrastructure
configuration

Application
deployment

Resource
provisioning

Hardware

© 2013 IBM Corporation

External

Ecosystem

Marketplace

App

API

API

Economy

services

API

analytics

API

commerce

API

collaboration

API

location

API

data

API

API


Software

as a Service

Platform

as a Service

Infrastructure

as a Service

Cloud
Operating
Environment



Workload definition, Optimization, & Orchestration

Software

Defined

Environment

Software Defined Compute

Software Defined Storage

Software Defined
Networking

Resource Abstraction & Optimization

Traditional

Workloads


Services & Composition Patterns

API & Integration
Services

Solutions

data

mobile

development

operational

application

services

security



Next
Generation Cloud
Platform changing the playing field

Cloudfoundry

© 2013 IBM Corporation

Introducing the
Full
-
Stack Engineer

31

Full
-
Stack Engineer

A developer that has the ability to define and automate all aspects of an enterprise workload
from the application components through the middleware down to the compute, storage, and
network settings

VLAN

App Server

Router

datastore

Liberty server

Logging

Config

security

App component

d
ata comp

©
2013
IBM Corporation

Software Defined Environments and
DevOps

enable rapid
service delivery

BVT

Production

QAT

Build

Publish
artifacts

Deploy
& test

Promote

Cloud OE

Service

Application

Promote
& test

UrbanCode

Deploy

Environment
dev

service

Cloudfoundry

Dev

service

CI service

Deploy
s
ervice

© 2013 IBM Corporation

DevOps

and deliver pipelines are not just for
IaaS

services

Developer

Running Application

(
Dev

Space)

Create
& edit

Running Application

(test)

Running Application
(Prod Space)

Running Application

(Test Space)

Empowering developers and optimizing delivery

Deploy
& test

Build

Publish
build

Deploy

Promote

Cloud Operating
Environment

Test as
a Service

Test

Monitoring as a Service

Monitor

Dev

service

CI service

Deploy
s
ervice

© 2013 IBM Corporation

Essay Topics

1.
What do you believe is the most influential technology trend that is driving and enabling the
use of
DevOps

practices and tools and why?


2.
What do you think the world of enterprise software delivery will look like in ten to fifteen
years (take into account practices, technology, and user experience)?


3.
How can you make
DevOps

“real” as part of your course work and projects?

34

© 2013 IBM Corporation

© Copyright IBM Corporation 2013. All rights reserved.
The information contained in these materials is provided for informational purposes only, and is provided AS IS without warra
nty

of
any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related t
o,
these materials. Nothing contained in these materials is intended to,
nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering
the

terms and conditions of the applicable license agreement governing
the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be
ava
ilable in all countries in which IBM operates. Product release
dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market oppor
tun
ities or other factors, and are not intended to be a commitment
to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelog
ic
logo, and other IBM products and services are trademarks of the
International Business Machines Corporation, in the United States, other countries or both. Other company, product, or servic
e n
ames may be trademarks or service marks of others.

www.ibm.com/software

35