Volume, Variety and Velocity all increasing rapidly

stuckwarmersMobile - Wireless

Dec 14, 2013 (3 years and 8 months ago)

217 views

The Formula for Hadoop Project Success

Gail Ennis


CEO

Volume, Variety and Velocity all increasing rapidly


Source: IBM, Oct 2012

OMG!…The Opportunity Is Huge

{
"
frequentlyPurchasedWith
": [], "color": "Black", "
skutype
": "parent", "
productTemplate
": "
Computer_Accessory
",
"
salesRankMediumTerm
": "3039", "
shortDescription
": "Compatible with Windows 8 and RT and Android 3.0 tablets;
Bluetooth technology; convertible stand/carrying case", "
includedItemList
": [{"
includedItem
": "Logitech Tablet Keyboard
for Windows 8 and RT and Android 3.0+ Tablets"}, {"
includedItem
": "4 AAA batteries"}, {"
includedItem
": "Owner's
manual"}], "
subclassId
": 2409, "
sku
": 6541967, "width": "12.3
\
"", "subclass": "BLUETOOTH KEYBOARDS", "source":
"
BoxStore
", "
modelNumber
": "920
-
004569", "digital": false, "department": "COMPUTERS", "type": "
HardGood
",
"
productId
": 1218752781558, "description": "None", "
technologyCode
": "None", "
longDescription
": "This Logitech 920
-
004569 keyboard features a low
-
profile, 65
-
key design for easy, comfortable typing on your Windows 8 or RT or Android
3.0 tablet. The convertible stand allows comfortable viewing and provides on
-
the
-
go protection for the keyboard."
,
"
categoryPath
": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"},
{"name": "
iPad
, Tablets & E
-
Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id":
"pcmcat231800050009"}, {"name": "Tablet Docks, Keyboards & Stands", "id": "pcmcat242000050003"}]
, "manufacturer":
"Logitech", "
classId
": 492, "
upc
": "097855090973", "
regularPrice
": 69.99, "class_1": "TABLET ACCESSORIES",
"
relatedProducts
": [{"
sku
": 4974041}, {"
sku
": 1306578835}, {"
sku
": 4640745}, {"
sku
": 9610542}, {"
sku
": 8785729}, {"
sku
":
6640676}]}

{"
frequentlyPurchasedWith
": [], "color": "Gray", "
skutype
": "parent", "
productTemplate
": "
Computer_Accessory
",
"
salesRankMediumTerm
": "None", "
shortDescription
": "Compatible with BlackBerry Playbook tablets; wool construction;
TPU plastic cradle; elastic band; metallic clip; functions as a stand; play
-
through design", "
includedItemList
":
[{"
includedItem
": "DICOTA
TabBook

Case for BlackBerry Playbook Tablets"}], "
subclassId
": 2404, "
sku
": 6738835, "width":
"5.5
\
"", "subclass": "SO TABLET ACCY", "source": "
BoxStore
", "
modelNumber
": "D30203", "digital": false, "department":
"COMPUTERS", "type": "
HardGood
", "
productId
": 1218789793935, "description": "None", "
technologyCode
": "None",
"
longDescription
": "This DICOTA
TabBook

D30203 case helps keep your BlackBerry Playbook tablet safe from hazards, with
wool construction and a TPU plastic cradle for durability and an elastic band to keep your tablet snug and secure in the
case.", "
categoryPath
": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"},
{"name": "
iPad
, Tablets & E
-
Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id":
"pcmcat231800050009"}, {"name": "Tablet Cases, Covers & Sleeves", "id": "pcmcat242000050002"}], "manufacturer":
"DICOTA", "
classId
": 492, "
upc
": "7332752000964", "
regularPrice
": 49.99, "class_1": "TABLET ACCESSORIES",
"
relatedProducts
": [{"
sku
": 6118882}, {"
sku
": 6118737}, {"
sku
": 1305180220}, {"
sku
": 4124528}, {"
sku
": 1304792301},
{"
sku
": 6744043}]
}

InformationWeek 2013

There’s certainly

challenges




A Success Formula for a Hadoop Project



=

=

WHAT

your
company &
you

HOW

best


practices

MORE B
I
?

Big Data Analytics

What Can
We Make
Happen
?

“Data Platform of Intent”

Big Data

Full

Fidelity
Analysis

Unstructured
Behavioral,

Open, Affordable

HADOOP

H
Q
L

BI

Data
Cube
Analysis

Structured,
Transactional

Closed, Expensive

RDBS & EDW

S
Q
L

Powered by the Community

Powered by Vendors

Report On What Happened?

Database of Transactions


1.
What auxiliary products should we recommend?


1.
What new features should our product have?


1.
How can we eliminate support issues?

Hadoop Innovation Use Cases … some examples

Another Idea

Score Your Predictive Models On Hadoop

Model Builder

Model Description

Hive
UDFs

Standard
Hive

Reinvent Your Career

Lead

Thrive

This is the time
to be the river,
not the rock


Big Data Projects on Hadoop

We’re On a
j
ourney that’s just starting

You

Are Here….Time to get going!

But first!


Education


Training


Certifications

#1.
Form a Partnership With LOB


Find a use case


Identify
some budget


Form
a project team


Be willing to educate
others


Partner on a
small POC, don’t boil the ocean

Hadoop Project Success

Best Practice
#1


Teams are Highly Cross
-
Functional




Product Manager (LOB)


Power Analysts (IT or LOB)


Business Analyst (LOB)


Product Manager (LOB


IT Architect (IT)


Project Manager (IT/LOB)


By 2016 the CMO will have
more budget than the CIO


-

Gartner Group

Marketing The “Budget Richest” LOB?


#2.
Use the Right Big Data Analytics tooling



Supports the entire time


Reuse and share for speed and efficiency


Leverage pre
-
built analytics


Hadoop Project Success

Best Practice

#2


PERSONALIZED ANALYTICS HUB

#3
. Embrace Full Fidelity Big Data Analytics


Not sampled, all the data


maintains richness


Don’t replicate or move the data


Keep complexity and TCO low

Hadoop Project Success

Best Practice

#3



Data

Warehouse

OLTP to OLAP

Mapping

Analyst

In Summary

In BI, The Analyst Was at the End of the Process

Ordering App

Financial App

Master Data

Staging

OLAP

Reports

BI Using

Data Cube
Analysis

Structured, Sampled
Transitional,
Closed, Expensive

RDBS & EDW

S
Q
L

Driven by Vendors

In Big Data Analytics on Hadoop

The Analyst is at the Center of the Process

Application

Analytics

Data

Unstructured
Behavioral,

Open, Affordable

HADOOP

H
Q
L

Analyst

Full
Fidelitiy

Analytics

Get distracted….

Or

Big Data on Hadoop Project

Thank You

We’re happy to help


Questions