Design Summit Apr 2011 - Sonian

quaggahooliganInternet και Εφαρμογές Web

5 Φεβ 2013 (πριν από 4 χρόνια και 4 μήνες)

197 εμφανίσεις

November 12
th
, 2012

5:30


7:30pm

Sponsored by

“Open Source in the
Cloud”

Sonian, Open Source and Sensu

November 12, 2012

Sonian’s Contributions


Fog
-

https://github.com/fog


Elasticsearch
-

https://github.com/elasticsearch


Openstack Swift
-

https://github.com/openstack/swift


Opscode Chef


https://github.com/opscode/chef/


Various Chef Tools:


https://github.com/portertech/chef
-
metrics


https://github.com/portertech/chef
-
journalist


https://github.com/portertech/recognizer


https://github.com/portertech/chef
-
irc
-
snitch


Home Built and Released


SCLI (Smart Cloud Command Line interface)


https://github.com/sonian/scli

(MIT)


Amazon
-
Pricing (Pricing Gem)


https://github.com/sonian/amazon
-
pricing

(Ruby)


ElasticSearch Jetty Plugin


https://github.com/sonian/elasticsearch
-
jetty

(Apache 2)


Sensu


Monitoring Framework


https://github.com/sensu

(MIT)

Sensu


“The Monitoring Router”


Monitoring Framework


Built for the cloud (Dynamic
Environments)


Ruby (EventMachine, Sinatra, AMQP), RabbitMQ, Redis


Messaging oriented architecture. Messages are JSON
objects. (Pub/Sub)


Ability to re
-
use existing Nagios plugins


Plugins and handlers (think notifications) can be written in
any language


Designed with modern configuration management systems
such as Chef or Puppet in mind


Lightweight, less than 1200 lines of code

Why We Built It


Highly Elastic Infrastructure


Nodes are created (Spot Nodes)


Bootstrapped (With Chef)


Take and process work


Terminated (when prices increase)


All before they are discovered and monitored by Nagios


Nagios is:


Difficult to Extend


Can not discover new services on its own


Generally Unpleasant


Keep It Simple™


The Idea:


Schedule the execution of
remote checks


Collect their Results


“Checks” are:


Is the server up?


How hard is it working?



Tied into Modern CM


Chef


Puppet


Message Oriented Middleware


RabbitMQ


Securely Routing
Checks/Results


Redis: Fast In
-
Mem K/V Store

Open Source = Community


Early Development


Recruit Community Experts


Help Test


Drive Early Roadmap


Develop Puppet and Chef modules


Release Day (Nov 1
st

2011)


Make Sensu Github Repo Public


Open IRC channel on Freenode (#sensu)


Blog posting and Twitter for marketing


Community, Community, Community


Adoption


Documentation


“Omnibus” Style Packaging for Quick Deployments

Contact


Pete Cheslock


Director of Technical & Cloud Operations @ Sonian


@petecheslock


http://about.me/petecheslock



We’re Hiring!


Please contact Sonian’s VP of Product Development Glenn
Snyder


glenn.snyder@sonian.net

Global Marketing

Outline


Level Set on Current Cloud Trends, pain points, and markets


Open Source Trends


OpenStack Introduction


What it is


Historical Evolution


Use Cases


Conceptual Architecture


Customer Adoption


Cloud Taxonomy







11

Global Marketing

Level Set On Cloud
trends

12

Global Marketing

Cloud is about Services, Not Systems: Consumer
Market Driving Trends

13

24/7 CLOUD
SERVICES

Anywhere,
Anytime,
Internet Access

Interconnected
mobile devices

Global Marketing

Enterprises: Same Cloud Services Goals But Different Market Segments
and Pain Points

14


Mega Datacenters


Homogeneous


Dense/Low Cost


Small Site (SMB/Branch)


Low Cost


Ease of deployment


Ease of management


Enterprise Datacenter


Heterogeneous


Legacy / Complex


Consolidating Quickly

Mega Datacenter

Enterprise Datacenter

Small Site (SMB/Branch)


Burdened by “legacy” infrastructure and
applications


Too complex to manage


Expensive to implement and maintain


Takes too long to realize value


Not easy to innovate


Security, compliance, and privacy concerns


Source: IDC

Global Marketing

Virtual Machines Already Outstripping Physical Machines

“2012: RATE(of VMs launched
per sec 6/sec) > RATE (at
which babies are born in the
US per sec 8/sec) (from
#VMW) #cloud”

Global Marketing

Extensive
Use of
SAN

Complex
Networks

Dense
Blades

>$2000 /
VM



Specialized
Skillset



Fixed
Capacity

But what about storage and networks?

Global Marketing

Better resource utilization for each server

Virtualization 1.0: Not up to the challenge

HOST 1

HOST 2

HOST 3

HOST 4, ETC.

VM

Hypervisor

(VMWare ESX, Citrix XEN Server, KVM, Etc.)

Hardware abstraction for each server

2. Cloud Data Center

3. Cloud Federation

1. Server Virtualization

Automation & Efficiency

Global Marketing

+

How do you empower people to self
-
service?

USERS

ADMINS

How do you make your apps cloud aware?

Where should you provision new VMs?

How do you keep track of it all?

But questions arise as the environment grows...


VM SPRAWL


CAN MAKE THINGS UNMANAGEABLE VERY QUICKLY

APPS

2. Cloud Data Center

3. Cloud Federation

Server Virtualization

1. Server Virtualization

Automation & Efficiency

Global Marketing

USERS

ADMINS

But questions arise as the environment grows...


VM SPRAWL


CAN MAKE THINGS UNMANAGEABLE VERY QUICKLY

A Cloud Management Layer Is Missing

APPS

2. Cloud Data Center

3. Cloud Federation

Server Virtualization

1. Server Virtualization

Automation & Efficiency

Global Marketing

APPS

What is needed is a cloud Operating System that
adds automation and control at scale

Creates Pools of Resources

Automates The Network

USERS

ADMINS



CLOUD OPERATING SYSTEM



Connects to apps via APIs

Self
-
service for users

2. Cloud Data Center

3. Cloud Federation

Server Virtualization

1. Server Virtualization

Automation & Efficiency

Global Marketing

Compute Pool

Network Pool

Load Balancing Pool

Image Service Pool

Storage Pool

Types of pools managed by the Cloud O.S.

COMPUTE, NETWORK, & STORAGE

2. Cloud Data Center

3. Cloud Federation

Server Virtualization

1. Server Virtualization

Automation & Efficiency

Global Marketing

Assembly Line IT

Global Marketing

Robotics Factory IT

Global Marketing

Open Source, OpenStack
Evolution and Trends

24

Global Marketing

Innovation + Open Source = Virtuous Cycle


Open source is leading, not following, in important areas
including
cloud, big data, mobile apps and enterprise mobility.



More than 50 percent of software acquired in the next five
years will be open source software.




Innovation, flexibility, cost, quality
of open source are some of
the top reasons that make it attractive for use



Companies most likely to be impacted by OSS have these
characteristics:
Business drivers to invest in IT, software
development is an essential strategic process, technology centric



When asked about revenue generating strategies likely to create
value for vendors, 52 percent of respondents said an annual,
repeatable support and service agreement was the most likely
value strategy



http://northbridge.com/2012
-
open
-
source
-
survey


Open Source Innovation


600,000+ OSS projects


100+ billion lines of code


10 million person
-
years of work


Source: Blackduck

Global Marketing

3. Cloud Federation

Automation & Efficiency

OpenStack is the Open Source Software Powering
Public and Private Clouds

Public Cloud:

OpenStack powers some

of the worlds largest public

cloud deployments.

2. Cloud Data Center

1. Server Virtualization

Private Cloud:

Run OpenStack software

in your own

data centers

Global Marketing


What is it:

An open source cloud operating system


30,000 lines of code to 600,000 in under 18 months


Who

s building it:

A worldwide community of developers


600+ developers, 250+ contributed in the last 12 months


6000+ individual members in 87 countries


Who is govering it:
The OpenStack Foundation, backed by AT&T, Canonical,
Cisco, ClearPath, Cloudscaling, Dell, DreamHost, HP, IBM, ITRI, Mirantis,
Morphlabs, Nebula, NetApp, Piston, Rackspace, Red Hat, SUSE, and Yahoo!
(so far)

Global Marketing

Wide
-
Ranging Community Support….

Confidential

28

3/18/2013

Global Marketing

OpenStack Timeline

2011

Feb 2011:

Bexar

Release

Apr 2011:

Cactus

Release

Sep 2011:

Diablo

Release

Apr 2012:

Design

Summit

Austin


Formation

Bexar


First Public
Code

Cactus


Community
Development

Forming


Working

Prototypes


Essex


“Production Ready”


却慢p攠䙯畮u慴楯i


f湣汵”敤 楮⁕扵湴甠ㄲ⸰4


Incubated: Network & Block
Storage


2012

Nov 2010

Dec

Feb

Apr

Jun

Aug

Oct

Dec

Feb

Apr

Oct 2011:

Design

Summit

Mar 2012:

Essex

Release

Nov 2010:

Austin

Release

Oct 2010:

Design

Summit

Apr 2011:

Design

Summit

Diablo


Workable Foundation


Exposes Gaps

Solidify Community


Loses VMware &
HyperV

Folsom


“Platform for Innovation”


Co牥rml慴景牭 景爠f湮”癡瑩o”


Network as a Service

Block Storage


Public Adoptoin

Multiple Scale Deployments


Jun

Aug

Oct 2012:

Folsom

Release

Global Marketing


Addresses Real Market Pains


Limits costly
software licenses


Limits lock
-
in

by vendors (VMware) & by providers (Amazon)


Allows for
massive scalability


Extensible hypervisor support (Xen, KVM, Hyper
-
V, etc.)


Offers standard
APIs

enabling growing cloud ecosystem


OpenStack is commoditizing the IaaS market from single provider (Amazon) to
many small copy cats (startups).

Lock
-
in &

Licenses

Open APIs

& Support

Provides

Reduces

OpenStack Value Proposition

Global Marketing

Popular OpenStack Use Cases


Service providers offering an IaaS compute platform


IT departments provisioning compute resources to teams and
projects


Processing big data with tools like Hadoop


Scaling compute up and down to meet demand for web resources
and applications

31

Global Marketing

OpenStack Conceptual Architecture

Confidential

32

3/18/2013

Global Marketing

There is a broad adoption of OpenStack across many
markets. The most common markets we have seen so
far have been:


Universities

Healthcare

CDN providers

Hosting providers

Start
-
ups

SaaS companies

Government



Confidential

33

Global Marketing

Vision for Complete

OpenStack Solution

Global Marketing

Complete Cloud Taxonomy

Admin Software

Web Services & APIs

Customer Management

Entitlement, rights

Billing

Self Service Portal

Metering

Infrastructure Software

Abstraction Software

Physical

Software as a Service

IT as a Service

Platform as a Service

Infrastructure as a Service

Everything as a Service

HVAC

Power

Facility

Network

Environmentals

Compute

Switch

Storage

OS

Hardware Virtualization

Operating System Virtualization

Application Run
-
Time Virtualization

Data Store

Monitoring

Intelligent Resource Manager

Workload Lifecycle Management

Platform Provisioning

Ser

Gov
/Workflow Automation

Orchestration

Information Service Management

Legacy Management

Firewall

Reporting

Analytics

IPS

Security

LDAP/AD

SSO

Overarching Systems

Global Marketing

Disruption

Global Marketing

Discussion