Business Analytics on System z

lavishgradeΛογισμικό & κατασκευή λογ/κού

25 Νοε 2013 (πριν από 3 χρόνια και 4 μήνες)

63 εμφανίσεις

© 2010 IBM Corporation




Changing Business with Information





September 16, 2010

Business Analytics on System z






© 2010 IBM Corporation

2

Agenda


The Changing Environment and Requirements


The System z Solution Foundation


IBM Smart Analytics System 9600


IBM Smart Analytics Optimizer


Getting Started


© 2010 IBM Corporation

3

3

The world is changing and becoming more…


The resulting explosion of information

creates a need for a new kind of intelligence


… to help build a Smarter Planet



Instrumented

Interconnected

Intelligent

3

© 2010 IBM Corporation

4

Imagine If Your Decision Makers Could…

Physician

Telco Loyalty

Manager

Supply Chain
Manager

Retail Sales
Manager

…predict and treat
high
-
risk patients to
proactively intervene
at time of visit?

…apply inferred social
relationships of
customers to prevent
churn?

…identify inventory
levels and order
demands at time of
order?

…determine which
discounts will drive
additional sales if
offered at time of
sale?

…optimize every transaction, process and decision at
the point of impact, based on the current situation,
without requiring that everyone be an analytical expert

© 2010 IBM Corporation

5

Business Requirements Have Changed

… and again require highest Quality of Service


According to Gartner:


Fewer than 15% of data warehouses in 2007 have been
designed to provide high availability, failover, disaster
recovery and the remaining components of mission
-
critical
systems.


The mixed workload performance will become the single
most important performance issue in Data Warehousing


Over 60% of current data warehouses fail when attempting
to deliver in
-
line operational BI and Analytics


Resulting in lost revenue or increased costs.


System z is again at the forefront


Proven reliability and continuous availability capabilities


Industry leading availability and workload management
capabilities


Exploiting synergic effects of proximity to the operational
data


Leveraging your investments in the platform

© 2010 IBM Corporation

6

Getting To The Answers Is Not Always Easy

The Pressure is On!




No way I can deploy a new
system by next quarter!


What is our consolidated
revenue?, I keep getting different
answers…


One solution, five vendors, ten
support numbers, ..we might as
well be system integrators.


Revenue & profits are down,…..
only thing that is up is my quota.


Whatever I spend to solve
today's problem must be relevant
to solve tomorrows as well.


Even if I had the applications I do
not trust my information.


No way my infrastructure can
support these new requirements.


6

© 2010 IBM Corporation

7


What Clients are Telling Us


We Need a Single System to Deliver
Our Analytics Needs


Simplified planning, purchase,
deployment, maintenance, and
growth


Designed for Enterprise class
analytics and performance


Pay as you grow Modular
-
based
Deployment



We Need Faster Time To Value


Pre
-
Built for Rapid Deployment


Pre
-
tested and Configured to your
requirement


Out of the Box Performance


Minimized risk through standards
and proven best practices



With Reduced Cost Of Ownership


Reduced integration costs



Less Storage, Server and floor
Space required


Reduced Labor


Reduced Energy Consumption


Improved system management


Flexibly add user and data capacity
to meet growth requirements



And Greater Access to Information and
Analytics


Pre
-
Configured Business
Intelligence Modules with flexibility
of functionality and style of delivery


Optimized and integrated OLAP
capability gives you performance at
the speed of thought


We Need ……………………
.

7

© 2010 IBM Corporation

8

8

IBM System z…the platform for the future



"you cannot think seriously about your longer
-
term IT architecture
without thinking equally seriously about what today's mainframe
environment has to offer“

CIO Magazine: Mainframe computing is
set for a rebirth


September 29, 2009

© 2010 IBM Corporation

9

The System z Solution Foundation

© 2010 IBM Corporation

10

Warehouse

Present

Acquire

ETL

Data Quality

ELT

Replication

EAI

EII

Data Warehouse/BI Basics


-

Four stages between Data and Information

Store

Cubing

Operational Source Systems

Structured/ Unstructured Data

Operationa
l

Application
s

Transform/

Optimize

IBM SPSS

Decision

Management


© 2010 IBM Corporation

11

The IBM Data Warehouse Solution on System z Foundation

z/OS LPAR

Enterprise Data Warehouse

z/OS LPAR

Operational System (OLTP)

DB2 for z/OS

DB2 for z/OS VUE

ELT

Solution Edition for Enterprise Linux

Solution Edition for zDW

z/OS

Data Sharing Group

LINUX ON SYSTEM Z


or z/VM LPAR

InfoSphere
Information

Server

InfoSphere
Warehouse

Cognos

BI Server

Linux


Consolidation of mission
-
critical
data on System z


Ability to leverage existing
environment, high availability,
backup and governance
procedures as well as skills


Efficient data movement between
LPARs and DB2 Subsystems


Performance and TCO
improvements through cubing
services (data marts) and DB2
enhancements


Complex transformations and
data quality driven from Linux on
System z with Information Server


Low Latency movement of data
with Replication Server

InfoSphere Replication Server

© 2010 IBM Corporation

12

12

The IBM Solution: IBM Information Server

Delivering information you can trust

IBM Information Server

Discover, model, and
govern information
structure and content

Standardize, merge,

and correct information

Combine and
restructure information
for new uses

Synchronize, virtualize
and move information
for in
-
line delivery

Unified Deployment

Unified Metadata Management

© 2010 IBM Corporation

13

13

InfoSphere Warehouse on System z


Provides a highly scalable, resilient, lower cost way to design, populate and optimize a
DB2 for z/OS Data Warehouse


Adds core data warehouse and analytics capability to DB2 for z/OS


Advanced physical database modeling and design


In
-
database data movement and manipulation capabilities of SQL Warehouse Tool (SQW)


Optimize multidimensional reporting and analysis of data with Cubing Service



13

Cognos

Excel



OLTP DB2

DWH DB2

SQW

MDX Queries

Cubing Services

© 2010 IBM Corporation

14

14

IBM InfoSphere Warehouse Cubing Services

Infosphere

Warehouse

Warehouse Modeling

Cubing Services

IBM Business Analytics

Large enterprise IT deployments

Primary OLAP Use:

Ideal for:


Very large data sets with very large
dimensions


Enterprise rollouts requiring near
real time data

For IT departments

Operational Planning, Financial
analytics, business reporting

Because of its unique:


Scalable, low latency OLAP


Standard, Open APIs


Integrated IT tooling

© 2010 IBM Corporation

15

15

Optimized Decision Making

Message
Sources

Modern and
Legacy Sources

Application
Sources

OLAP
Sources

Relational
Sources

Easy access to a consistent, trusted and relevant view of
information where, when and how it is needed

Intuitive and tightly integrated capabilities accommodate

decision makers with different needs and skill sets

Common Business Model

Cognos

© 2010 IBM Corporation

16

16

Measure and Monitor to See “How” You’re Doing

Dashboards


Provide at
-
a
-
glance, high impact views of complex
information


Help quick focus on issues that need attention and action


Combine information across disparate sources


Benefit from range of highly visual personalized,
managed, or self
-
assembled dashboards


Gain personalized views of operations with continuous
monitoring

H

Real
-
time Monitor Business Operations


Continuously monitor and alert when

exceptions occur to take immediate action


Detect events, anomalies and trends in data streams
flowing through transactional and messaging systems


Aggregate data streams across multiple transactional
systems and data sources


Enable self
-
service with user
-
defined dashboards,
operational KPIs, and alerts


Address full operational decision cycle from detection to
action

Monitor

Alert

Analyze

Respond

Cognos

© 2010 IBM Corporation

17

17

Start to Understand the “Why” Behind Business Performance

Reporting


Address full breadth of report needs (personalized,
transactional, management, statutory, production…)


Deliver consistent information across all types of output


Personalize and target to each department/individual
without having to re
-
author


Re
-
use queries, analyses, express author reports in
business and collaborate on design with IT


Easy access to data lineage, definitions of terms, and
annotations

Ad
-
hoc Query


Intuitive, self
-
service reporting


Access to all data; drag and drop query creation


Easy sorting and filtering


Corporate templates for consistency


Share ad
-
hoc or promote for professional distribution

J

© 2010 IBM Corporation

18

Miami Dade County Success Story



Why Leverage Cognos 8 BI for Linux on System z

Requirements:


Demand for BI has really taken off


New regulatory reporting requirements


Every new system, every new solution, every
new application is having a business
intelligence component



Multiple Cognos 8 BI deployments
-

6+


Wanted an enterprise BI standardized
solution, but


Needed higher capacity


grow from approx
400 to 1000 users


Do more with less
-

less researchers, less
software, less hardware, same staff



Had available IFL’s on System z

Results:


11 days to move from distributed to System z
deployment model for Cognos 8 BI


Quickly and easily meet new requirements


Consolidate multiple BI deployments on to a
single platform


Single point for BI administration


Consolidate multiple disparate data sources


Ensure 99.999% availability


Offer a complete disaster recovery plan


Additional green savings

Objective: Using System z to standardize on a single BI solution

© 2010 IBM Corporation

19

IBM Smart Analytics System 9600

© 2010 IBM Corporation

20

IBM Smart Analytics System Offerings Deliver Analytics
Value Across Platforms

Faster Time to Value, Faster Business Results

Meeting clients where
their information is…

7600

Based Power System

9600

Based on System z


5600

Based System x


20

Consistent value,

Right fitted to your needs

© 2010 IBM Corporation

21

IBM Smart Analytics System 9600





What’s new:


Delivers a complete end
-
to
-
end software, hardware, and services solution for deploying business
analytics on System z at a compelling price point.


Features / Business Value:


Provides unprecedented value for an end
-
to
-
end analytics solution on System z


Inherits the unique System z quality of service, for new business analytic workloads


Delivers continuous availability to a centralized single view of the business to support enterprise
-

wide business analytics


Features an advanced Workload Manager that can easily prioritize critical queries within a large
pool of queries.


Leverages customers existing disaster recovery, and backup processes to simplify deployment
without requiring additional backup and recovery processes.


Delivers
-

unprecedented value in deploying new business analytics



Client Benefits:


To deliver enterprise
-
wide business analytics
to operational users


Deliver business insights to the right person,
at the right time, in the right context


© 2010 IBM Corporation

22

InfoSphere
Warehouse

Cubing
Services

Cognos 8 BI

IBM Smart Analytics System 9600

High Value Dynamic Warehousing

ELT

Operational Source Systems

Structured/ Unstructured Data

Data

Warehouse

System z

Implementation

Services

DB2 for z/OS VUE

(
option for MLC)

DB2 Utilities Suite

Image Copy, LOAD, UNLOAD,
REORG, etc


Powercube
Services

© 2010 IBM Corporation

23

Choose A Deployment Style

Virtual Upgrade

Delivery

Standalone Delivery

Server delivered in
“appliance
-
like” fashion

Capacity delivered as a “bolt
-
on” to existing server(s) or as
new server(s) depending on
customer needs in a “virtual
appliance
-
like” fashion

© 2010 IBM Corporation

24

DB2 Base

Amt Usable Disk*

Amt

User Data*

240TB

100TB

120TB

50TB

60TB

25TB

24TB

12TB

8TB

4TB

IBM Smart Analytics System

Pre
-
Set Configurations Sized to Meet Business Requirements

Data Capacity Sizing

*Usable = Disk storage delivered for compressed table
data, indexes, work files, MQTs etc.

*User Data = Processing capacity delivered to support
this amount of raw, uncompressed, user business data

© 2010 IBM Corporation

25

IBM Smart Analytics System

Pre
-
Set Configurations Sized to Meet Business Requirements

Cognos Workload

Named Users

Max Concurrent Users


10,000


100





50



5

25



BI Capacity Sizing

*Named User = Licensed Cognos User

*Concurrent User =
Users that are doing work (consuming CPU) in the
Cognos application, DB2 or both


© 2010 IBM Corporation

26

What exactly is a “User”?


“Named User”


“Active User”


“Concurrent User”


“DB2 ‘In
-
Use’ Thread
User”


This is a licensed
Cognos user.

This is a member of the
subset of “Named
Users” that are
currently logged in to
the Cognos application

Users that are doing
work (consuming CPU)
in the Cognos
application, DB2 or
both

Users that are actively
running in DB2
(consuming CPU in
DB2)

Best defined as the
general user
community that may or
may not be using the
Cognos application at
any given point in time

This user community
includes users that
are:


Actively doing work in
the application (which
may or may not also
incur work in DB2)


In “think time”


Have walked away from
their machine

The Cognos work may
or may not incur work
in DB2

© 2010 IBM Corporation

27

IBM Smart Analytics System Optimizer

© 2010 IBM Corporation

28

IBM Smart Analytics Optimizer


How is it different


Performance:

Unprecedented
response times to enable 'train of
thought' analyses frequently blocked by
poor query performance.


Integration:

Connects to DB2 through
deep integration providing transparency
to all applications.


Self
-
managed workloads
: queries are
executed in the most efficient way


Transparency:

applications connected
to DB2, are entirely unaware of the
accelerator


Simplified administration
:
appliance
-
like
hands
-
free operations, eliminating
many database tuning tasks

What is it?

The IBM Smart Analytics Optimizer is a
workload optimized, appliance
-
like, add
-
on, that
enables the integration of business insights into
operational processes to drive winning
strategies. It accelerates select queries, with
unprecedented response times.


Breakthrough Technology Enabling New Opportunities

© 2010 IBM Corporation

29

DB2 for z/OS

Optimizer

IBM SAO interface

Query execution run
-
time for
queries that cannot be or should
not be off
-
loaded to IBM SAO

IBM SAO

.

.

.

Coordinators

Application

Application

Interface

Queries executed with IBM SAO

Queries executed without IBM SAO

Heartbeat

Heartbeat (IBM SAO availability and performance indicators)

Worker 1

Worker 2

Worker 3

Worker n
-
1

Worker n

IBM Smart Analytics Optimizer


Query Execution Process Flow

© 2010 IBM Corporation

30

Extreme performance for complex queries

Game Changing Performance


Rapidly delivers information to decision
makers through breakthrough
technologies providing dramatic
performance improvement.


The best of row and columnar store
technologies


Highly compressed data


Compressed data operations


In
-
memory processing


Massively parallel architecture



Enables decision makers to submit
queries they never dared in the past, that
analyze trends, predict outcomes, and
produce better business results.


© 2010 IBM Corporation

31

Database Performance Appliance


Appliance
-
like, add
-
on device


Application transparent, install and
begin reaping the benefits of higher
performance


Rapidly add new applications and user
requirements driving immediate value to
the bottom line


No need for indices, materialized query
tables (MQTs), query plans or query
hints

Significantly reduces costs and
enables quick time to value

© 2010 IBM Corporation

32

Proven Operational Characteristics


Integrated infrastructure that is managed by System z
through Hardware Management Console and firmware

Benefits of a System z workload
optimized infrastructure



It broadens the System z Qualities of
Service of manageability, security,
availability to the business intelligence
and data warehouse workloads.


It extends the established System z
hardware management environment to
the workload optimized platform.,
centralizing and simplifying the
deployment and management

Creates New Opportunities for Existing Systems
by Using New Technology Approaches

© 2010 IBM Corporation

33

Comparing the Smart Analytics offerings in System z:

IBM Smart Analytics

System 9600

IBM Smart Analytics

Optimizer

Complete, end
-
to
-
end environment for BI workload
Processes ALL queries submitted by end
-
users

Software:

Includes z/OS, DB2 for z/OS, Linux, InfoSphere
Warehouse, Cognos, DB2 Connect

Supports:

Data movement / ETL

End user tools (Cognos) / BI queries/reports

Data Storage (Data warehouse)

Runs in z/OS
-
DB2 LPAR, Linux for System z LPAR for
Tooling

Is an all purpose environment to deploy any BI
workload


Workload optimized, appliance
-
like,
add
-
on

to a
Data Warehouse on System z

MUST connect TO a DB2 for z/OS environment that
is running a BI workload

Will enhance a Smart Analytics System 9600

Software:

Includes IBM SAO software running on blades and
connects to DB2 for z/OS to enable query routing
to IBM SAO

Supports:

(Subset of) complex and long
-
running BI queries
with access to data in a star or snowflake schema

Order of magnitude acceleration of a SUBSET of
queries that are selected/routed to IBM SAO by
DB2 for z/OS

GA June 2010

GA 4Q 2010

For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option

Uses Features of Accelerator

© 2010 IBM Corporation

34

Getting Started

© 2010 IBM Corporation

35

Websites for Additional Information:



IBM Smart Analytics System 9600 Webpage:

http://www.ibm.com/software/data/infosphere/smart
-
analytics
-
system/



IBM Smart Analytics System Optimizer Webpage:

http://www.ibm.com/software/data/infosphere/smart
-
analytics
-
optimizer
-
z/




Data Warehousing and Analytics

http://www.ibm.com/software/data/infosphere/data
-
warehousing/




Data Warehousing and Business Intelligence on System z

http://www.ibm.com/software/data/businessintelligence/systemz/



Terabyte Club for System z BI customers


http://www.ibm.com/software/data/businessintelligence/systemz/terabyte
-
club.html



Data Governance on System z


http://www.ibm.com/software/data/db2imstools/solutions/compliance.html





© 2010 IBM Corporation

36

Some Key Redbooks


Enterprise Data Warehousing with DB2 9 for z/OS


www.redbooks.ibm.com/abstracts/sg247637.html?Open



50 TB Data Warehouse Benchmark on IBM System z


www.redbooks.ibm.com/abstracts/sg247674.html?Open



DB2 for z/OS: Data Sharing in a Nutshell


www.redbooks.ibm.com/abstracts/sg247322.html?Open



System Programmer’s Guide To: Workload Manager


www.redbooks.ibm.com/abstracts/sg246472.html?Open



Workload Management for DB2 Data Warehouse, REDP
-
3927


www.redbooks.ibm.com/abstracts/redp3927.html?Open

Cognos on
System z,
Data
Collocation,
and
InfoSphere
Warehouse
also in
progress!

© 2010 IBM Corporation

37

Global Name
Recognition

Warehouse

Cognos
BI

InfoSphere
Information
Server

ETL

Data Quality

Dynamic Warehouse


The Integrated Stack for System z

InfoSphere
Industry Models

InfoSphere
Warehouse

Cubing

InfoSphere
MDM Server

Information
Services
Director

Data Synchronization

Replication

Server

Classic Event
Publisher

Classic
Federation

Federation

Change Data

Capture

Operational Source Systems

Structured/ Unstructured Data

Operational

Applications

Global

Name

Recognition

Master
Data

Smart
Analytics
Optimizer

Smart Analytics
System 9600

SPSS

© 2010 IBM Corporation

38

Dylan Murphy

System z InfoSphere and Data
Warehousing Technical Specialist

dsmurphy@us.ibm.com

(914) 766
-
7248