IBM Scale Out Network Attached Storage (SONAS)

capybarabowwowSoftware and s/w Development

Oct 30, 2013 (3 years and 9 months ago)

96 views

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

1

IBM Scale Out Network Attached Storage (SONAS)

GSE Sep 1, 2010


IBM Nederland STG

Rick Koopman

Building a Smarter Planet with IBM Information Infrastructure

IBM/GSE Presentation


© 2010 IBM Corporation

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

2

agenda

Smarter Planet and Information Infrastructure Challenges

Scale out NAS addresses storage challenges

Scale out NAS deployment and addressing scalability

IBM SONAS Benefits Industries and Workloads

IBM SONAS architecture

Why Smart Businesses like IBM SONAS

IBM SONAS hardware and software

Implementation services

ISV support

Features and benefits summary

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

3

3

For a smarter planet, we need our infrastructure to

propel us forward, not hold us back.

We need a smarter infrastructure.

+

+

+

+

Mobility

Infrastructure


Production

Infrastructure


Technology

Infrastructure


Communications

Infrastructure


Facilities

Infrastructure


Infrastructure that is instrumented, interconnected and intelligent …

… that brings together business and IT to create new possibilities.


IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

4

The Information Infrastructure Must Cope with Scale



In data



In numbers of producers



In numbers of consumers


Data Center

Distributed Computing

Internet, Web 2.0

Internet of Things

KB

MB

GB

TB

1980

1990

2000

2010

PB

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

5

Businesses can experience data access and data management
challenges


Businesses need
access to information

in order for employees to be productive


Businesses are experiencing
explosive growth

in volumes of information


Easy, and
quick access

to information is a must


This demand for access can result in several storage
-
related
challenges


Growing workgroup
communities



Large

information volumes


Lack of

seamless storage node scalability


Excessive

time and labor spent managing various server,
storage and software components



IBM SONAS addresses storage challenges

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

6

NAS can be deployed in your environment in two ways


Departmental file access has been the traditional approach to centralized storage


Install boxes or (individual islands of data)


A
new approach

-

IBM brings you the
next evolution

in file management and NAS


IBM brings you the
IBM Scale Out Network Attached Storage (SONAS)


Sharing data across business line
boundaries

is becoming increasingly common


Next evolutionary approach is to allow businesses to be
globally connected

with
one single access point
for millions and even billions of files


Businesses leverage the massive scale out and collaboration


capabilities of IBM SONAS



IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

7

The departmental approach to NAS has limitations


NAS systems installed to serve a specific department or geographic location have
limitations


A single NAS device has
limited performance and storage capacity

so it can
only support a finite number of servers or end
-
user workstations which can result
in:


Fragmented
, isolated islands of information


Limited sharing

of data between departments


Underutilized

storage resources

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

8

Centralized Management and Administration


“I loved my first filer. It was so easy to
administrate. When we installed the 20
th

I
started loathing them.”


Many enterprises now have
hundreds


Each filer has to be individually
administrated


Operation costs grow linear with the
amount of filer


IBM Scale Out NAS is a
super
-
scalable,
scale out NAS cluster, centrally managed,
centrally deployed


Integrated, automated tiered storage
allows management of logical storage
tiers instead of individual disks

IBM Scale Out NAS

Classic Filers

IBM Scale Out NAS solution makes operation easy

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

9

Storage Utilization, Automated Tiered Storage


Capacity managed individually


Average Utilization usually <50%


All files online, but over 80%
haven't been accessed during
the last 6 months


Capacity managed centrally


Average utilization >80%


Automated tiered storage


Policy driven file movement between tiers


Store petabytes of storage on terabytes of disk
(inactive files are auto
-
migrated to tape, VTL or de
-
dup)


Migration as granular as a ‘per file’ basis

IBM Scale Out NAS

Classic Filers

Goal: Implement tiered storage automatically

And buy just the capacity that you really need

$

$

$

$

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

10

Storage environment …. Before:

End Users

File Servers

Database

Underutilized Segmented Storage

Copies of Data

Application Servers

High
-
End Workstations

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

11

IBM Scale Out NAS

… After:


Global

virtual

file

server


Protocols

CIFS

NFS

HTTP

FTP

SCP






Management

Central

Administration

Monitoring

File Mgmt








Availability

Data Migration

Replication

Backup






Global namespace

Automated movement between

tiered storage pools

Clustered

High

Perf.

Auto
-
Tiered

Storage

High perf.

Scan engine

Tiered storage

De
-
dup VTL

Or tape

High perf.

at petabyte

scale

End users

High end

workstations

Application
servers

Database

A Global

Virtual

File

Server

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

12

IBM SONAS addresses these challenges


IBM SONAS offers businesses a unified place to:


Store massive amounts
of data for business growth


Virtualizes file space

to create a single, global name space for data


Provide access

to data for individuals, groups, departments and applications


Protect data
by managing access permissions, performing backups and developing
disaster recovery plans


Manage data

throughout the lifecycle by helping to ensure uptime and optimizing
performance


Prioritize data

with HSM


Optimize

storage
costs

by using tiered storage levels

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

13

Web Content
Store

Collaboration Data
& General File
Storage

Energy & Geo
-

Sciences

High Performance
Analytics

Digital Media

Hyper
-
scalable storage for large Web 2.0
stores and for other vendors looking to
build their own Cloud/SaaS applications

General purpose file storage environments
where clients are challenged with the
manageability of current NAS systems

Energy exploration and geo
-
sciences
require huge addressable namespaces and
very high performance.

Business applications such as financial
services interested in cloud deployments
with single namespace

High performance, simplified management
for widely varying use cases in digital
media environments.

Many environments needing easy
-
to
-
manage high performance, scalable storage.

CAE

Auto / Aero / Electronics design processes
experiencing rapid file
-
centric storage
growth as simulation expands.

IBM SONAS Benefits Industries and Workloads

Retail Banking &
Financial Markets

Chemical & Petroleum

Healthcare

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

14

IBM SONAS is suited to many business applications


E
-
mail


Photo sharing


Blog hosting


Software as a Service (SaaS)


Social network hosting


Wiki farms


Online service providers

Chemical & Petroleum

Online Service Providers

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

15

IBM SONAS is a paradigm shift in data access


IBM SONAS from IBM enables a
global file system namespace



It’s a single storage environment made up of many
smaller, clustered

components


No longer limited to a few nodes, it becomes possible to provide a wide range of data storage
services on
mixed media

(fast disk, slower disk, tape)



Large number of nodes can operate as a single cluster


They’re
easier to manage

as a single cluster


They
eliminate single points of failure


They’re better for
managing loads

because they
support access to:


Many small data files (text files)


Large data files (analysis, CAD/CAM, image
rendering, video)


Any combination of file size, application or data type
according to business requirements


Users have

fast, reliable access

to data regardless
of physical location

/

/sales

/finance

/web

Global name space,
Every file is
accessible from all interface nodes

IBM SONAS

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

16

IBM SONAS
-

Architecture


NFS, CIFS and other popular network file protocols


1GbE and 10GbE host interfaces


Work load and data is
evenly distributed

across all
nodes and disk pools, eliminating hot spots.


All nodes

continuously
serve all files



every node is
the same (not failover pairs).


Near linear

aggregate performance and capacity
scaling


Healthy nodes take over workload of failed node


High speed, low latency (20 Gbps) private Infiniband
cluster data network


High density RAID controller and disk expansion drawer
(4U x 60 HDD’s)


Support for high
-
performance SAS and high
-
capacity
SATA HDD’s

* Planned future 2010 release

...

“Cloud” IP Network

Clients

Clients

Clients

Management
Node

Interface
Nodes

Interface
Nodes

Internal Network

...

Storage
Node

Storage Pod

High Density
Controller

Storage
Node

High Density Dual
RAID Controller

High Density
JBOD

High Density Dual
RAID Controller

High Density
JBOD

Storage
Node

Storage Pod

High Density
Controller

Storage
Node

High Density Dual
RAID Controller

High Density
JBOD

High Density Dual
RAID Controller

High Density
JBOD

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

17

Applying IBM SONAS architecture to storage environments


Scale out architecture is the right way to handle large volumes of data


Many
inexpensive

servers are clustered to work cooperatively


End users and applications see a
single
, large, high
-
throughput

file system


The architecture allows for availability, performance
failover
,

and, most important, scale out capability with improved performance


The NAS servers are managed logically as a single entity


The environment appears to the end user as a single data storage space

even if it is
made up of hundreds of individual nodes


IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

18

Anticipated business advantages of IBM SONAS


Enhances

individual and organizational
productivity and responsiveness
through
improvements to file accessibility, information sharing and fast search capabilities


Enables

new business applications and processes


Helps support
disaster

recovery and business
continuity

strategies


Improves the
security

stance of intellectual property and supports

compliance

efforts


Reduces

total cost of ownership through consolidation

of server and storage environments


Stores data relative to its value to the business

through support for information lifecycle

management initiatives


IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

19

Why Smart Businesses like IBM SONAS


Unified management of terabytes and petabytes of storage


Global access to data, from anywhere, anytime


Based on standard, open architectures


Not proprietary


Avoids lock
-
ins


Leverage worldwide Open Source innovative technology


Provides and exceeds today’s needed requirements for:


Extreme scale out of capacity and performance


Global virtual file server


Modular “
Lego Like
” building block expansion


High ROI


Significant cost savings due to auto
-
tune, auto
-
balance,
automatic tiered storage


Position to exploit the next generation of storage technology


Superb foundation for cloud storage


IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

20

IBM SONAS

Fully Integrated

Scale Out Network Attached Storage (NAS) system with
differentiated, world
-
proven
General Parallel File System



Global file system namespace


File system snapshots, quotas,


Scalable, Integrated Information Lifecycle
Management (ILM)*

Tiered storage

HSM support to external Tivoli Storage Manager
(TSM) server*


Integrated System Health Center for HW monitoring


LDAP Support (OpenLDAP, Tivoli Directory Server)

* Planned future 2010 release

42

MGT Node

MGT Node


2 to 6

Interface Nodes

Storage Node

Storage Node

Switches

1 or 2

Storage

Controllers

60 disk each


0, 1 or 2

Expansion
Units

60 disk each



Storage Pod

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

21

IBM SONAS
-

Expansion Options

Node Expansion



Up to 30 interface nodes


High speed extremely low latency (20 Gbps) private
Infiniband cluster data network


Storage Expansion



Up to 30 storage pods, each with up to 240 HDD’s


Scalable to 14.4 PB of storage in single system using
(2 TB SATA disk drives),


Max of 7,200 hard drives


Minimum 27 TB with 60 (450 GB SAS disk drives)


Minimum 60 TB with 60 (1 TB SATA disk drives)

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Switches

Storage Node

Storage Node

60 Disks

60 Disks

60 Disks

60 Disks

Storage Node

Storage Node

60 Disks

60 Disks

60 Disks

60 Disks

Switches

I/O Dense
Configuration

Storage Dense
Configuration

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

22

22

Sample designs for IBM SONAS system

Multiple variations exist to allow for I/O rich or Storage rich systems: almost 1 PB per rack.

Extreme aggregate single system capacity and performance

MGT Node

MGT Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

KVM

Storage Node

Storage Node

60 Disks

60 Disks

60 Disks

60 Disks

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Interface Node

Switches

Switches

Storage Node

Storage Node

60 Disks

60 Disks

60 Disks

60 Disks

Storage Node

Storage Node

60 Disks

60 Disks

60 Disks

60 Disks

Switches

I/O Dense
Configuration

Storage Dense
Configuration

Base
Configuration

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

23

Expandable
Interfaces

COTS

components

Core Systems
Software

CIFS

IBM

General Parallel

File System


(GPFS)

Enterprise Linux with associated device drivers

Performance & Availability

Monitoring Agents

System Health Center

NFS

FTP

HTTPS*

Clustered Trivial database (CTDB)


Overall System Manager

HSM client daemons

Backup & Restore

Mgmt.

Interface

SCP*

Replication mgr

IBM SONAS


Software Stack

* Planned future 2010 release

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

24

IBM SONAS
-

Integrated Lifecycle Management Policies


Placement policies at file creation:


Example: place CIO’s files in a gold pool, others in silver

rule 'home' set pool 'gold' for fileset 'CIO'

rule 'others' set pool 'silver'



Migration policies:


Example: Migrate large CIO files when pool gets close to
full

rule ‘CIO' migrate from pool ‘gold' threshold(90,70) to pool
‘bronze' where file_size > 1024kb




Deletion policies
:


Example: Delete files in bronze pool after 365 days

Delete filesrule 'purgebronze' when day_of_month()=1 delete
from pool 'bronze' where access_age>365 days



In addition, there are Policies for File based
Backup/Archive, Restore/Retrieve

Note: ILM is planned for future 2010 release

Backup


Uniquely integrated TSM clients
in each interface node provides
for faster, easier backup to TSM



Other backup platforms also
supported over the network

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

25




Single, Integrated Installation wizards

Entire cluster installed from one DVD from one node


Health Center/Cluster monitoring

System Log

Alert Log

Topology


IBM SONAS Console Settings

Utilization Thresholds

Scheduled tasks

Notification settings

Notification recipients


IBM SONAS Ease of Management

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

26

IBM SONAS Product Delivery



Delivered as an integrated rack mounted Storage Appliance



For simplicity, a minimum # of options:

# of interface nodes, Controllers or JBODs, 15K SAS or SATA
drives



Serviced as a single part number



Each SONAS node runs a copy of SONAS Software



Preinstalled in the factory on the hardware



No additional software charges for specific functions

(e.g. CIFS/NFS, snapshots, replication, per TB charges)



Flex Warranty, with 1 year standard hardware/software, NBD


Flex warranty provides customer choice in additional years and response
times



IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

27

ISV Support



IBM is currently testing key ISV applications to ensure compatibility and certification with
IBM’s Scale Out Network Attached Storage



Examples of ISV related tests include:


Symantec Anti Virus End Point Protection v11.o over CIFS


Symantec Anti Virus for Linux v1.0.7 over NFS


Symantec Net Backup on Windows Server 2003
-

Out of Bound Backup over CIFS


Symantec Net Backup on Linux RHEL v5.4
-

Out of Bound Backup over NFS


VMware ESX Server 3.5 Update 4 with Virtual Infrastructure 3 (includes Virtual Center)


VMware vSphere v4 (including ESX Server v4 and VI as well as Virtual Center Server
and Client, Win2k3)


IBM Tivoli TSM


Oracle RAC 11G AIX


Oracle RAC 11G Linux


VMware support for Clusters


IBM will be delivering ISV related support documentation


Technical White Papers


Solution Briefs

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

28

IBM SONAS Features and User Benefits

Feature

Potential Benefits

Simple, expandable Storage Appliance

Ease of ordering, deployment, and management

Centralized Management of all files, single
namespace

Reduced Administrative costs, faster response
time to end users

File Placement policies including automation

Optimized storage costs, reduced administrative
costs

No individual chargeable add
-
on software

Reduced TCO, Simpler Procurement process

Automated policy based hierarchical storage
management: HSM, ILM*

Reduced administrative costs, optimized storage
costs

Independent scalability of storage and nodes

Simple but flexible configurations tailored to
customer specific workloads

Concurrent access to files from all nodes, token
management

Very high performance, reduced administrative
costs related to migrating hot spot files

Storage Pool striping

Very high performance
-

fast access to data

Metadata scanning across all available
resources/nodes, integrated TSM clients

Faster backups of files

Snapshots, Asynchronous Replication*

Data Protection/Disaster Recovery

* Planned future 2010 release

A
d
m
in
is
tr
at
io
n/
T
C
O

P
er
fo
r
m
a
n
c
e

Dat
a

Prot
ecti
on

IBM/GSE Presentation


© 2010 IBM Corporation

Building a Smarter Planet with IBM Information Infrastructure

29