Slide 1

townripeData Management

Jan 31, 2013 (4 years and 2 months ago)

299 views

The State of Open Source Business Intelligence

Christian Donner

www.molecular.com

2

Getting from data to the source of a problem can be hard ...

A czar learned that the most disease
-
ridden province of
his empire was also the province with the most doctors.

His solution?

He promptly ordered all the doctors shot dead.

Folktale from: Freakonomics
-

A Rogue Economist Explores the Hidden Side of Everything (Steven D. Levitt, Stephen J. Dubner)

(He clearly lacked Business Intelligence)

www.molecular.com

3


… or easy …

"How would you rate the overall job President George W. Bush is doing as president

--

excellent, pretty good, only fair, or poor?

Source: Harris Poll, published by the Wall Street Journal Online on 5/12/2006

Excellent or pretty good

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

90.00%

May

April

March

February

January

November

August

June

April

February

November

October

September

August

June

April

February

December

October

August

June

April

February

December

November

October

September

August

July

June

May

April

March

February

January

December

November

October

August

July

June

May

March

February

2006

2005

2004

2003

2002

2001

www.molecular.com

4

Poll


Who has implemented something that you would define as
a BI solution before, either in your own organization or for
someone else?


Out of this group, who has used an Open Source BI
product?



Survey on
http://cdonner.com

(20 responses):

Currently using BI

85%

Currently using OSBI

40%

Evaluated OSBI in the past

40%

Planning to use OSBI

35%

www.molecular.com

5

Why this presentation?


2 years ago I started a low
-
budget BI project


Researched many products and technologies


OSBI was practically non
-
existent


Decided to go with Microsoft DTS and SQL RS


Today, the landscape has changed dramatically


I wanted to know: would I go with Open Source BI today?

www.molecular.com

6

Agenda


What is Business Intelligence?


BI Trends


OSBI Trends


Products


Pentaho


Jaspersoft


OpenI


BIRT


Bizgres


Mondrian


Demo


www.molecular.com

7

Business Intelligence


A Definition


Business Intelligence


In 1989 Howard Dresner (Gartner Group) created the term "BI“:

“A set of concepts and methods to improve business decision
-
making by using fact
-
based support systems.”


Wikipedia:


the technology used for collecting and analyzing business
information


a set of business processes for this purpose


the information obtained from these processes


Includes:


ETL Tools


OLAP/Data Analysis Tools


Reporting Tools


Databases


www.molecular.com

8

Business Intelligence
-

Components

Operational Datastore
ETL
Extraction
Relational Datastore
Multi
-
dimensional Datastore
Storage
ROLAP
MOLAP
Aggregation
Reporting
BI Platform
Delivery
www.molecular.com

9

Business Intelligence Platform


Integrate with business
processes


Manage and schedule
reports


Deliver reports through
multiple channels, push and
pull model support


Maintain user security


Seamlessly integrate via
open standards with portals
and applications

www.molecular.com

10

Agenda


What is Business Intelligence?


BI Trends


OSBI Trends


Products


Pentaho


Jaspersoft


OpenI


BIRT


Bizgres


Mondrian


Demo


www.molecular.com

11

Forecast: Business intelligence market growth

2003

2004

2005

2006

2007

2008

$5,253M

$5,596M

$5,997M

$6,506M

$7,005M

$7,331M

6.5%

7.2%

8.5%

7.7%

4.7%

N/A

BI services revenue

BI maintenance revenue

BI license revenue

Size

Growth

Actual

Forecast

BI market
size

(US$ millions)

Source: Forrester Research, “Business Intelligence Growth Is Driven By Compliance, Standardization, And Performance Initiativ
es”

$0

$2,000

$4,000

$6,000

$8,000

www.molecular.com

12

Mainstream BI Theme


Keith Gile, Forrester Research:

“We are witness to a change in BI that shifts the
emphasis away from functionally powerful tools for
power
-
user “producers” toward context
-
sensitive BI
solutions for a large community of “consumers” of
information.”


Paul Doscher, CEO Jaspersoft:

“The big commercial tool providers can handle
performance management applications well, but left
Operational BI behind.”


License bottleneck


Lower
-
level in
-
house user


Public web sites

www.molecular.com

13

Forrester Wave™: BI Enterprise Reporting, Q1 ‘06

Where are
the Open
Source
contenders?

Source: Forrester Research

www.molecular.com

14

Agenda


What is Business Intelligence?


BI Trends


OSBI Trends


Products


Pentaho


Jaspersoft


OpenI


BIRT


Bizgres


Mondrian



Outlook


www.molecular.com

15

Why Open Source?

Source: Survey by Computer Economics, Frank Scavo

www.molecular.com

16

The Jaspersoft Story: BI for Everyone

Operational executives are being asked to make decisions more critical to the
Corporation more frequently especially with the added scrutiny of SOX compliance.

Legacy BI Companies have failed to solve the Problem


We have Business Objects installed on our corporate data
warehouse and 80% of our users only use 20% of the
functionality.”

Michael Heschel, EVP Information Systems and Services, The Kroger Company


A typical installation for a 1000 users for the full BI suite could run

As high as $450k
-

$700k for software licenses alone.”

Intelligent Enterprise, August 2005

The full Business Objects product takes

180

CDs to install!!!

This slide © 2005 JasperSoft, Inc.

www.molecular.com

17

Organizational Involvement with OS BI

21%

19%

43%

8%

9%

Has deployed open source


BI software

In development with

open source BI software

Considering open

source BI software

Not Considering open

source BI software

Don’t Know

(c) 2006 Ventana Research Open Source and BI Research

www.molecular.com

18

Comparison of OS BI with Commercial BI

Cost of Ownership

(c) 2006 Ventana Research Open Source and BI Research

Scalability/Performance

Openness/Flexibility

Database Support

Reliability

Metadata Support

Manageability

Ease of Use

77%

80%

72%

69%

62%

57%

61%

57%

Significantly more Capable

More Capable

Equivalently Capable

Less Capable

Significantly less Capable

Don’t know

www.molecular.com

19

Extranet Applications
-

The “Beachhead” of Open Source BI?


Technology
requirements favor open source


Pure J2EE offerings provide a better technology fit than legacy
BI technology


Licensing

requirements contradict prevailing proprietary models


“Named user” only


doesn’t map to extranet usage


Role
-
based


meaningless in extranets


>$1,000 USD per name user


cost prohibitive


Net/net: The “old school” BI licensing model breaks down

www.molecular.com

20

Free software for sale!


Community
-
based vs. for
-
profit companies


Open Source has become a business model


Acquisition of
your vendor
can change the terms under
which you use OS SW


Example: Bill Venners account of using Jive for
Artima.com


Example: Snort,
Sale of Martin Roesch’s Checkpoint
Software


Whatever you do, factor in that your Open Source product
may not always remain that.

www.molecular.com

21

Example: Jaspersoft Business Model


JasperIntelligence Product Family


JasperReports, iReports


Jasper Decisions, Jasper Server


Soon: JasperAnalytics, JasperETL



Commercial / Dual license


Services packages

on Subscription basis (JS & JR)


Commercial License, Support, Training, Documentation


CPU based Pricing plus Support (JD)


Support pricing (JR)


Incident support plus three annual support options from web based self
-
service to comprehensive 24x7x265



Leveraging strong and loyal community


SourceForge


JasperForge

This slide © 2005 JasperSoft, Inc.

www.molecular.com

22

Agenda


What is Business Intelligence?


BI Trends


OSBI Trends


Products


Pentaho


Jaspersoft


OpenI


BIRT


Bizgres


Mondrian



Outlook


www.molecular.com

23

OSBI Explosion


There are about 25 products competing
in this space, about half of which did not
exist prior to 2005.


Many of them will probably return to
insignificance


Because we are so early in the maturity
cycle, it is difficult to make judgments
about who will make it.

www.molecular.com

24

Open Source Reporting Tools


Eclipse BIRT (Actuate)


Jasper Reports


JFreeReport


DataVision


Open Reports


OpenRPT


Agata Reports


www.molecular.com

25

Eclipse BIRT


(Business Intelligence) and Reporting Tools


Eclipse Report Designer (ERD)


Eclipse Report Engine (ERE)


Eclipse Charting Engine (ECE)


Web Based Report Designer (WRD)


Source: Actuate

www.molecular.com

26

BIRT 2.0 Features


Released
January 20, 2006


Re
-
Use Library


A report component environment allows developers
with a range of expertise to share report components or functions for
reuse.


Page
-
on
-
Demand HTML
-

A page
-
on
-
demand navigation mechanism
enables the efficient viewing of large report documents over the
internet.



CSS Style Sheets


External style sheets can be used across multiple
report designs, making it easy to establish a common look across all
reports in one application.




Scripting Editor


BIRT supports the ability to code or script the
behavior of reports using a perspective for Java Code Editing for BIRT
reports.


Large, Persistent Reports


Report developers can generate a report
and then distribute a URL to end
-
users.


Improved Charting Facility, Scripting


BIRT 2.0 includes a wizard
for building common usage charts and advanced capabilities for
including detailed charts within a report design.

www.molecular.com

27

Open Source OLAP Tools


Mondrian


JPivot


gOLAP


PALO


pocOLAP


www.molecular.com

28

Open Source ETL Tools


Clover ETL


CPluSQL


Enhydra Octopus


JetStream


KETL


Kettle


OpenDigger

www.molecular.com

29

Open Source BI Suites


BEE


Bizgres


Openi


Pentaho


SpagoBI

www.molecular.com

30

JasperIntelligence Architecture

Customers

Business Analyst

Domain User

Executive

USER

COMMUNITY

Operational Data

Source

Content Store

Report Definition

Rendered Content

Images, Fonts, etc

Meta Data

JasperServer

Cube /

Data Mart

Inventory

Purchasing

Finance

CORPORATE

DATA



JDBC, POJO, XML, XML/A

HTTP, SOAP, Web Services, Java
API

OUTPU
T

Reporting Services

Metadata Services

OLAP Services

JasperETL

JasperIntelligence Platform

ETL Services

JasperReports

JasperDecisions

JasperAnalysis

JasperETL

PDF

HTML + AJAX

MS EXCEL

MS WORD

JasperExplorer

This slide © 2005 JasperSoft, Inc.

www.molecular.com

31

Pentaho

Source: Pentaho

www.molecular.com

32

OpenI

Source: OpenI/Loyalty Matrix

www.molecular.com

33

OpenI at a Glance


J2EE Web Application


Standards
-
based, integrates other Open Source
components


Connectors for Relational (JDBC), OLAP (XMLA), and data
mining data sets (RServe) currenly only XMLA


Supports Jasper .jrxml and custom RDL


JPivot for Pivot tables, JFreeChart


Supports JSP
-
168


Form
-
based authentication with J2EE Security


www.molecular.com

34

Bizgres


Sponsored by Greenplum


Bizgres is a distribution of PostgreSQL (Open Source DB)


Bizgres includes the following components:


PostgreSQL 8.1.3 (Open Source RDBMS)


Bizgres Loader (Mass data loading utility)


Demonstration Programs and Utilities


KETL Integration (
ETL solution for web log analysis)


JasperReports Integration


Bizgres Clickstream



www.molecular.com

35

Bizgres Clickstream Architecture

Source: Greenplum

www.molecular.com

36

Who leads the pack
?

Downloads by Month
0
10000
20000
30000
40000
50000
60000
Feb-
05
Mar-
05
Apr-
05
May-
05
Jun-
05
Jul-
05
Aug-
05
Sep-
05
Oct-
05
Nov-
05
Dec-
05
Jan-
06
Feb-
06
Mar-
06
Apr-
06
Mondrian
JFreeReport
Pentaho
Jasper Reports
Source: sourceforge.net

www.molecular.com

37

Agenda


What is Business Intelligence?


BI Trends


OSBI Trends


Products


BI suites


ETL tools


OLAP


Reporting tools


Databases


Demo


www.molecular.com

38

The State of Open Source Business Intelligence


“Business intelligence” is a broad umbrella term


Lot of buzz in the media and from analysts


Young and growing market


Immature, but rapidly improving products


No clear market leader


www.molecular.com

39

Thank you!

Would I go with Open Source BI today? How about you?


Q&A