Air Force Personnel Operations

basheddockDéveloppement de logiciels

21 févr. 2014 (il y a 3 années et 3 mois)

70 vue(s)


Copyright © 2011 SAS Institute Inc. All rights reserved.

Data
Integration
Strategy

Air Force Personnel Operations
Agency


Human Resources

December 2, 2011

2


Copyright © 2011, SAS Institute Inc. All rights reserved.

Agenda
-

TOC


Who
is SAS?


Where is SAS in the Air Force


Essential Business Process Agility


Data Integration and Information Management


Data
Quality: Cleansing
and
Enrichment


Data Integration/Management Benefits


Why SAS for
AFPOA


Resources and Further Contact Information


3


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS


Leader in
Applied Analytics







Largest privately held software
company in the world


2010 Revenue: $2.43 Billion


35 Years
of
consecutive
g
rowth


24% reinvestment in R&D for 2010


50,000 deployments worldwide


12,000 employees


90 of the top 100 of Fortune Global 500


All 15 U.S. Departments and 90% of
U.S. Federal Agencies


All 50 U.S. State Governments


Government agencies in 80
countries


Outstanding Technical Support Services



Other: 1%

Energy & Utilities: 3%

Education: 3%

Retail: 4.5%

Manufacturing: 5.5%

Life Sciences: 6%

Communications: 7%

Services: 11%

Financial Services: 42%

Government: 15%

4


Copyright © 2011, SAS Institute Inc. All rights reserved.

Hill AFB

Brooks, Randolph

Lackland

AFBs

Tinker AFB

Maxwell AFB
-
Gunter

Hanscom

AFB

Where SAS is in the U.S. Air Force



Langley AFB

Chantillly
, VA &

Washington, D.C.

Wright
-
Patterson
AFB

Barksdale AFB

Edwards AFB

Peterson AFB

LA AFB

In a new framework for AF Human Resources, these SAS installations
could be streamlined
if
needed or leveraged.

Eglin AFB

Hurlburt

Field

Huntsville

Malmstrom

AFB

Nellis

AFB

Kirtland
AFB

Patrick AFB

Offutt
AFB

Scott
AFB

Robins AFB

5


Copyright © 2011, SAS Institute Inc. All rights reserved.

Essential for Business Process Agility


UNIFIED

PLATFORM
for
Information

DATA

INTEGRATION

DATA

QUALITY

MASTER
DATA

DECISION

MGMT.

ANALYTIC
MGMT.

DATA
ACCESS

Data Integration defined in terms of Information

Data
Access/Integration/Quality

Data Governance for

Airman Personnel PII

Analytical Model Management
and Governance

Recalibrate or New

Decision Management
Support

Performance and Cost

Master Data

Best Record Airman Personnel

6


Copyright © 2011, SAS Institute Inc. All rights reserved.

Data Diversity:

Big Data

Use Case
Diversity

Unified Data
Management

Consumption
Diversity:

Mobility

Application
Diversity:

Operational
Analytics

Temporal
Diversity:

Right
-
Time

Architecture
Diversity:

Enterprise
Architecture

Deployment
Diversity:

Cloud

Role Diversity:
IT/Business
Acceleration

Information Management

is required to meet the current
d
emands in the Business and
Technical landscape

Data Integration and
Information
Management

The Opportunity

Managing information
for Air
Force personnel
who are the
most valuable asset includes the
ability to value information
appropriately


7


Copyright © 2011, SAS Institute Inc. All rights reserved.

DATA SERVICES

Analytics
Management

Data
Management

DATA & ANALYTIC SERVICES

DATA GOVERNANCE

ANALYTICS GOVERNANCE

DATA
INTEGRATION

ENTERPRISE DATA ACCESS

Infrastructure
Support

INFRASTRUCTURE SUPPORT:

Text & Unstructured Data Support, Events, Security, Meta
-
data & Lineage, Monitoring & Deployment

DATA
QUALITY

MDM

DECISION
MANAGEMENT

MODEL
MANAGEMENT
&
MONITORING

MODEL
DEPLOYMENT
&
INTEGRATION

Data Management and Integration

Capability View

Agile And Responsive To Changing Requirements

Linking
IT Strategy to

Business
Strategy

8


Copyright © 2011, SAS Institute Inc. All rights reserved.

Data Management












Data Management

Enterprise Data
Access and Federation

Data Management

Data

Quality

Data

Integration

Master Data

Management

Architecture is rigid; not flexible to changes in business needs

Managing end
-
to
-
end processes is
challenging

Resolves

UNIFIED
PLATFORM
INFORMATION
MANAGEMENT

9


Copyright © 2011, SAS Institute Inc. All rights reserved.

Why
SAS/DataFlux
for Data
Management


SAS the Original Data Warehouse
Pioneer


35
years Data
Management Experience


Thousands of Data Management
Customers worldwide


End
-
to
-
end Solution Available


Gartner
Leader for DQ


Gartner Leader for DI


Gartner DI Leader Best
-
in
-
Class Data
Access Technology


Shortest Time to delivery for MDM


Scalable Grid Enabled Platform


Only Data Management vendor with
integrated analytic scoring


World Class Partner Network


Thousands of consultants worldwide


Growth through consistent R&D


DataFlux

Proven Market Leader in Data Management

Recognized as a leading provider of enterprise data
quality, data integration, data governance and MDM
solutions

Over 2,300 customers worldwide

Offices throughout the US, the UK, France,
Germany and Australia

Founded
in 1997

Acquired by SAS in 2000

Operates as a wholly owned
subsidiary

UNIFIED

PLATFORM
INFORMATION
MANAGEMENT

10


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS’ Data Management Portfolio


SAS Data Integration Server


SAS Data Integration Server


SAS Enterprise Integration Server


SAS Data Quality Solution (Server minus DI Studio)


DataFlux Data Management Platform


Data Management Studio


Data Management Server


Data Federation Server


qMDM



Master Data Management


DataFlux Solution Accelerators


DataFlux Event Stream Processor


Supporting SAS Technologies


SAS
/
Access

»
Interface to <insert favorite RDBMS > / Interface to PC Files


SAS Integration Technologies

»
Message Queuing APIs, Web Services, Publishing Framework



UNIFIED

PLATFORM
INFORMATION
MANAGEMENT

11


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data Management
Advantage


Access?

Any Data, Anywhere, Anytime: Best
-
in
-
Class Data Access Technology



SAS/Access What is it?


SAS/ACCESS
Interfaces
are out
-
of
-
the
-
box solutions that
provide enterprise data access and integration between SAS and
third
-
party databases.


SAS/ACCESS
interfaces
are
highly optimized
to enable
your
SAS
®

solutions to read, write and update data regardless of its
native database or platform.


Because
the data appears native to SAS, there is no need to
learn Structured Query Language (SQL) or any other database
-
specific query languages
.


All data is presented unified to users, complex activities like bulk
loading are simplified, cross source integration is seamless.

»
SAS
leverages the
underlying RDBMS
for you transparently

»
For example, a single option is used to invoke bulk loaders

»
DATA
MyORA.ORACLE_TABLE
(BULK_LOAD=YES)



DATA ACCESS

12


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data Management Advantage

Any Data, Anywhere, Anytime:
Best
-
in
-
Class Data Access Technology



RDBMS



SAS/ACCESS Interface to DB2


SAS/ACCESS Interface to Informix


SAS/ACCESS Interface to Microsoft SQL


SAS/ACCESS Interface to MySQL


SAS/ACCESS Interface to ODBC


SAS/ACCESS Interface to OLE DB


SAS/ACCESS Interface to Oracle


SAS/ACCESS Interface to Sybase


SAS/ACCESS Interface to Sybase IQ


SAS/ACCESS Interface to Teradata


MPP Database Appliances


SAS/ACCESS Interface to Aster Data
n
Cluster


SAS/ACCESS Interface to
Greenplum


SAS/ACCESS Interface to
Netezza


SAS/ACCESS Interface to
Exadata


SAS/ACCESS

Interface to ODBC


(
ParAccel
,
Vertica
, Microsoft PDW)


Non
-
Relational



SAS/ACCESS Interface to ADABAS


SAS/ACCESS Interface to DATACOM/DB


SAS/ACCESS Interface to IDMS/R


SAS/ACCESS Interface to IMS
-
DL/I


SAS/ACCESS Interface to PC Files


SAS/ACCESS Interface to SYSTEM 2000


Enterprise

Applications



SAS Data Surveyor for
SalesForce.com


SAS
Data Surveyor for Oracle Applications


SAS Data Surveyor for SAP


SAS Data Surveyor for Siebel


OLAP


Message Queues


XML


Web Services


Unstructured, Semi
-
Structured And more…


Enterprise
-
wide
, net
-
centric to meet the
operational needs of the
AF

DATA ACCESS

13


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data
Integration and Management
Benefits and Features

Data Integration


Tasks

SAS

DataFlux

Other ETL Tools

Table Creation

Low

Effort

High Effort

Fast Extract

Automatic

Separate Utility

Batch

&

Real
-
Time

Low Effort

Multi Step

Deployment

Data Quality

Integrated

Separate Tool

Data Services

Low Effort

Custom

Code

Sorts

&

Join

High Performance

Low


Performance

SQL

Pushdown

Automatic

High Effort

Federated Views

Automatic

Separate Tool

Parallelism

Low Effort /

Any Job

High Effort /

Limited

Job Sets

Scoring

Integrated

Custom Code

Customization


Low Effort

High Effort

DATA
INTEGRATION

14


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data Management Workbench


Execute Data Quality Workflows


Metadata Driven Environment

»
Deploy governance within the IT
infrastructure

»
Determine integration method

»
Real
-
time

»
Batch

»
Virtual

»
Reuse and redeploy the same set of
business rules across applications


Review execution results

»
Exceptions

»
Debugging

»
Tuning

»
Optimization


DM System Reporting

14

DATA
INTEGRATION

Data Integration via a Flexible and Powerful Interface

15


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data Management
Advantage

S
calable : In
-
Database EL
-
T


Visual Indicators show you where processing takes place.


Push
-
down is a simple option set on the SQL transform.


Users can control where processing takes place, two clicks enable
users to “move first then process” via bulk loader.


DATA
INTEGRATION

16


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data
Management
Advantage

Analytic Integration : Integrated Scoring


Integration of Predictive analytics from SAS’ Enterprise Miner into
Data Management tasks, takes just two clicks.


Shared Metadata provides the lineage of model dependencies and
where models are consumed


With Scoring Accelerator Scoring Functions can be Pushed
“In
-
Database” and called via SQL Function calls from DI Studio

DATA
INTEGRATION

17


Copyright © 2011, SAS Institute Inc. All rights reserved.

Metadata Management



Sophisticated metadata mapping
technologies accelerates
development


Impact Analysis/Data Lineage to see
process and data relationships


Multi
-
user Collaboration with
DEV/TEST/PROD promotion
management


Powerful metadata reporting
including runtime and performance
analysis


User Interface Roles and Security


DATA
INTEGRATION

18


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS
Data Management Advantage

Best in Class: DataFlux Data Quality



Embedded into batch, near
-
time and
real
-
time processes.


Rules callable through message
queues, Web services and custom
exits.


Data cleansing provided in native
languages with localizations.


Metadata built and shared across
the entire SAS Platform.


Generate and append postal
addresses, geo
-
coding,
demographic data or facts from other
sources of information.


Profile operational data and monitor
ongoing data activities.


DATA
QUALITY

19


Copyright © 2011, SAS Institute Inc. All rights reserved.

Data Cleansing and Enrichment


Data
quality, including integrated
profiling,
exploration, business rules creation, entity
resolution and monitoring
.


Process
orchestration layers for jobs, SAS code
and SQL.


Data
quality is embedded into batch, near
-
time
and real
-
time processes.


Out
-
of
-
the
-
box
standardization rules; or you can
create customized, reusable data quality
business rules.


Data quality rules are callable through message
queues, Web services and custom exits.


Data
enrichment and augmentation.


Real
-
time transaction cleansing using standard
business rules.


Data
quality monitoring lets you continuously
examine data in real time and over time to
discover when quality falls below acceptable
limits. Alerts are issued when corrective action is
needed
.

DATA
QUALITY

20


Copyright © 2011, SAS Institute Inc. All rights reserved.

Business Rules to Track Data Events

Events from
business
r
ules are
SOA
e
nabled


DATA
QUALITY

21


Copyright © 2011, SAS Institute Inc. All rights reserved.

DataFlux
Data Management Web Studio

Triggered rules:

Filter:

Monitor

Rule

Date

Importanc
e

%
Triggers


# Triggers

Rows
Processed

Status

Reason

Assigned User

Rule 1

6/10/2010 1:1:1
PM

3

563

5002

Unresolved

Integration

Franz Kafka

Rule 2

6/9/2010 1:1:1 PM

6

786

4789

Rule 3

6/8/2010 1:1:1 PM

2

42

4378

Unresolved

Aging

Ernest Hemingway

Rule 3

6/7/2010 1:1:1 PM

1

31

4023

Unresolved

Integration

Joseph Conrad

Rule 4

6/6/2010 1:1:1 PM

6

856

3874

Unresolved

Organizati


Ernest Hemingway

Rule 5

6/5/2010 1:1:1 PM

3

343

3689

Unresolved

Process

Joseph Conrad

Rule 6

6/4/2010 1:1:1 PM

1

11

3241

Unresolved

Transform


Ernest Hemingway

Rule 6

6/3/2010 1:1:1 PM

1

51

3241

Assigned

Usage

Joseph Conrad

Rule 3

6/2/2010 1:1:1 PM

2

92

4378

Assigned

User Error

Joseph Conrad

Rule 3

6/1/2010 1:1:1 PM

1

31

4023

Assigned

Aging

Joseph Conrad

Rule 4

5/30/2010 1:1:1
PM

6

696

3874

Resolved

Integration

Mary Cassatt

Rule 4

5/30/2010 1:1:1
PM

6

696

3874

Resolved

Integration

Mary Cassatt

History Graph

Monitor



9/7/2009

10/7/2009

11/7/2009


12/7/2009

1/7/2010

2/7/2010

3/7/2010

4/7/2010

5/7/2010

6/7/2010

7/7/2010

10

8

6

4

2

0

Date

Trigger Percentage

Trigger History (Percentage of Rows Processed)

Trigger Values

Rule Code

Summary

Status


Apply
Clear

This week

Date:

Repository:

Importance :

Source:

Rule:

Task:

Description:

General
*

Term

Statistics

Run

Status

Table


Open Table

Total count:
24


Monitor on the Web;
M
ultiple repositories


W
orkflow capabilities

Monitor Data Quality

DATA
QUALITY

22


Copyright © 2011, SAS Institute Inc. All rights reserved.

3721B

Entity Resolution for Data Services

Knowing your Airman

Cust. Id

3721B

First Name

Willaim

Middle

James

Last Name


Corp.

DOB

April 12

SSN


56349123

Address

3224 Pkwy G, Los Osos

ERP

Cust. Id

30391
-
244

First Name

William

Middle

James

Last Name

Sosulski

DOB

04/12/1939

SSN

563
-
49
-
1234

Address

123 Oak St., Eves, IL 30319

Data

Warehouse

Cust. Id

14239

First Name

Bubba

Middle

J.

Last Name



DOB

April 12

SSN



Address

BubbaJ@bubbagroup.com

Online

Cust. Id

30391244

First Name

William

Middle

J.

Last Name

Sosulski

DOB

4
-
12
-
39

SSN

563491234

Address

123 Oak St., Eves, IL

CRM

Cust. Id

30391
-
244

First Name

William

Middle

James

Last Name

Sosulski

DOB

04/12/39

SSN

563
-
49
-
1234

Address

123 Oak St., Eves, IL 30319

Legacy

William

James

Sosulski

04/12/1939

563491234

123 Oak Street

Eves

CA

91403

30391
-
244

1001

14239

30391
-
244

30391244

22

MASTER
DATA

23


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS Data Management
Benefits

Control & Lower TCO


Integrated DQ Functions


Specialized DQ Interfaces


SOA
Enabled


Lineage Reporting from Source to Report


Over 300 Functions 70 built
-
in Transformations


Analytic Integration & Scoring


Scalable
Partition
-
Based
Parallelism


Record
Setting File I/O


Best
-
in
-
Class Data Access Technology /w/ Widest Array of
Data Sources and Targets


Version Control



DATA
INTEGRATION

24


Copyright © 2011, SAS Institute Inc. All rights reserved.

Feature

Why it Matters

Data quality rules automatically exposed
as
RESTful

and SOAP Web Services

Seamless integration with AFPOA
enterprise architecture and workflow

All tools are built on a 4th Generation
SAS Programming Language and C++

Enables AFPOA to more easily adapt
SAS/DataFlux data management
capabilities to changing mission needs

Unified runtime across computing
environments

Enables AFPOA to attain cloud
computing environments

Why SAS for AFPOA?

Flexibility

Agile and responsive to meet the needs of the Air Force’s most important asset:

Air Force Personnel

25


Copyright © 2011, SAS Institute Inc. All rights reserved.

PERFORMANCE

CULTURE

EXPERIENCE

THOUGHT LEADER

#1 World Leader in Business Analytics

50,000+ Customers

12,000 Employees Worldwide

Relentless Innovation

Voted #1 Place to Work in U.S.

Trusted Partner to Governments and Leading
Business Organizations

50,000 SAS Sites in 127 Countries

93 of the Top 100 Companies in 2011 Fortune
Global 500

35 Years Leading Analytics Solutions

SAS Advanced Analytics Lab Provides Business
Leadership

Domain Expertise in Key Industries

Culture of Innovation: 24% R&D Reinvestment

SAS Can Be Your Trusted Partner

26


Copyright © 2011, SAS Institute Inc. All rights reserved.

Resources

Here are the URLs and titles of downloadable materials we refer you to
for more information:


SAS
Data Management
-

http://www.sas.com/software/data
-
management
/

From this webpage, you can access downloadable materials and drill
down deeper into


Data Integration


Data Quality


Enterprise Data Access


Master Data Management


Here are two additional white papers you might find helpful which
were provided to Bloor.


“Data Quality Remediation” (
DataFlux
)



DataFlux

Data Management Methodology: A Do
-
It
-
Yourself Guide for
High
-
Value Data Across the Enterprise” (
DataFlux
)

27


Copyright © 2011, SAS Institute Inc. All rights reserved.

SAS
®

Data Integration










Thank you!

If you are interested in hearing more about SAS and how we
address
Information and Data Integration Management,
please contact:


Gail Bamford

Industry Marketing Manager for Defense & Intelligence

Gail.Bamford@sas.com

571
-
227
-
7000 x51715