IBM Message Broker Practical Examples for SOA - WebSphere ...

therapistarmySoftware and s/w Development

Dec 14, 2013 (3 years and 10 months ago)

127 views

WebSphere User Group
IBM Message Broker
Practical Examples for SOA
Anthony O’Dowd
WebSphere Message Broker Architecture and Strategy
odowda@uk.ibm.com
WebSphere
© 2011 IBM CorporationWebSphere User Group
Important Disclaimer
THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR
INFORMATIONAL PURPOSES ONLY.
WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND
ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT
IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED.
IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT
PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT
NOTICE.
IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE
USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER
DOCUMENTATION.
NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL
HAVE THE EFFECT OF:
• CREATING ANY WARRANTY OR REPRESENTATION FROM IBM (OR ITS
AFFILIATES OR ITS OR THEIR SUPPLIERS AND/OR LICENSORS); OR
• ALTERING THE TERMS AND CONDITIONS OF THE APPLICABLE LICENSE
AGREEMENT GOVERNING THE USE OF IBM SOFTWARE.
2 © 2010 IBM CorporationWebSphere User Group
Agenda
 Connectivity Overview
 Message Broker Usage Patterns
 Message Broker Processing Scenarios
3 © 2010 IBM CorporationWebSphere User Group
ESB Connectivity Overview
4 © 2010 IBM CorporationWebSphere User Group
ESBs Simplify Connectivity
File
MQ/JMS
soap/jms
soap/http
http
Enterprise Service Bus
WebSphere MQ
5 © 2010 IBM CorporationWebSphere User Group
Enrich your SOA connectivity …
Service Enrichment
•Match & Route communications
between services
•Converts between transport protocols
•Transforms between data formats
•Identifies and distributes bus events
… simplifying the overall architecture and reducing IT cost
6 © 2010 IBM CorporationWebSphere User Group
Enterprise Service Bus Review
Connects everything to
Matches & routes communications
everything
between services
Transforms between
Distributes Business
different data formats
events
Converts between different
transport protocols
Service Virtualization Aspect Oriented Connectivity
Service Virtualization Aspect Oriented Connectivity
Routing Security
Routing Security
Protocol and transports Management
Protocol and transports Management
Transformation of interfaces Audit…
Transformation of interfaces Audit…
7 © 2010 IBM CorporationWebSphere User Group
WebSphere Message Broker
 Universal Connectivity FROM anywhere, TO anywhere
– Simplify application connectivity for a flexible & dynamic infrastructure
 Protocols, Transports, Data Formats & Processing
– Supports a wide range of built-in transports, protocols & systems
• MQ, JMS 1.1, HTTP(S), SOAP, REST, File (incl. FTP & FTE), Database, TCP/IP, MQTT…
• CICS, IMS, SAP, SEBL, PeopleSoft, JDEdwards, SCA, CORBA, email…
– Supports a broad range of data formats
• Binary (C/COBOL), XML, CSV, JSON, Industry (SWIFT, EDI, HL7…), IDOCs, User Defined
– Message Processors
• Route, Filter, Transform, Enrich, Monitor, Publish, Decompose, Sequence, Correlate, Detect…
 Simple Programming with Patterns & Graphical Data Flows
– Patterns for top-down, parameterized connectivity of common use cases
• e.g. Service façades, Message processing, Queue2File…
• IBM & User defined patterns for development reuse & governance
– Graphical data flows represent application & service connectivity
• Custom logic via graphical mapping, PHP, Java, ESQL, XSL & WTX
 Extensive Management, Performance & Scalability
– Extensive Administration & Systems Management facilities for developed solutions
– Wide range of operating system &hardware platforms supported, including virtual & WCA Hypervisor
– High performance transactional processing, additional vertical & horizontal scalability
– Deployment options include Trial, Remote Deployment, GetStarted, Enterprise
8 © 2010 IBM CorporationWebSphere User Group
Processing Scenarios & Usage Patterns
9 © 2010 IBM CorporationWebSphere User Group
Many Defined Patterns for MB Solutions
Service
Virtualization
Gateway
Service
Enablement
OR
OR
OR
Event-driven
Message-based
Integration
Integration
File Processing
http://www.ibm.com/developerworks/wikis/display/esbpatterns/
10 © 2010 IBM CorporationWebSphere User Group
Typical Customer Usage Patterns
 Extend the Reach of Existing Applications
 Connect File with Online for End-to-End Efficiency
 Connect Devices to the Enterprise
 Get the Most from Packaged Applications
 Distribute Database Information to Where It’s Needed
 Make An Application Inventory and Govern processing with a Registry
 Provide a PEP for Secure Application Connectivity
 Monitor your Business Activity and Act Intelligently
 Develop and Reuse Solutions with Patterns
11 © 2010 IBM CorporationWebSphere User Group
Extend the Reach of Existing Applications
Expose existing applications without change
SOAP & Web 2.0 based access to existing systems
Create a gateway for routing and security
INBOUND and OUTBOUND scenarios
SOAP Web Services Established as Interoperability Standard
– SOAP support allows MB to act as WS-* façade to existing non WS-* applications
• Support for SOAP/HTTP and SOAP/JMS (any), includes transactions & asynchronous processing
– SOAP gateway functionality for WSDL-less, policy based processing in large web service networks
• Examples range from simple service re-direct to payload verify/sign, encrpyt/decprypt with routing
 Web 2.0/REST Provides Lightweight Universal Access
– HTTP ubiquity & REST semantic provide universal access to existing systems MB
– Popular with both XML and JSON payloads (JSON for lightweight clients)
WS provider
 Outbound Scenarios enable Existing Applications to request New Services clients
– Existing application can invoke and exploit new services with existing technology
 Typical Customers
– US Payroll Corp. exposes MQ applications via self service SOAP interface for responsiveness & accuracy
– WW (US based) Airline access external web services from existing JMS/MQ reservation system
– US Wireless Operator expose legacy billing systems via HTTP/XML for customer self service
– Swedish Banking group uses gateway to authenticate, lookup, authorize & route to backend web service
12 © 2010 IBM CorporationWebSphere User Group
Connect File and Online for End-to-End Efficiency
Share the valuable business data in your files
Create an efficient pipeline between your file data and on-line applications
Control a well managed, flexible file infrastructure
 Streamline batch oriented and on-line processing with the MB
– Message Broker provides end-to-end file processing: gets stationary data moving!
– Typical scenarios are file to queue, database to file, file to file, file to SAP, File PubSub…
– Comprehensive file systems support includes local files, network mounted file, FTP and SFTP
– Process whole-file or record-at-a-time; simple delimiters to complex COBOL, XML & user defined
 Timely, Intelligent, Transactional Transfers with FTE nodes
– FTE Input and FTE output nodes allow MB to receive and send FTE transfers
– Installed seamlessly as part of regular install, auto configured client name, transfer directories etc.
– Timely processing: file is processed once FTE agent confirms notifies of complete file transfer
– Add intelligence to your file processing via user specified metadata
– FTE’s transactional underpinning & MB sequencing for once-and-once only files!
 2011 Sterling C:D Integration
– MB and C:D MFT can now integrate seamlessly
– Exploits C:D specific capabilities including C:D process steps
 Typical Customers
– German Retailer uses MB & FTE for POS reporting to HQ & price list distribution to store
– NE US Retailer using FTE & MB to provide timely inventory updates to and from online systems
13 © 2010 IBM CorporationWebSphere User Group
Connect Devices to the Enterprise
Monitor remote systems and devices
Provide near real-time insight about physical systems, and act
 Industry Observation
– “How to we get information from everywhere, understand it, and act?”
– Medical, Energy and Utilities, Distribution, Transport, Gaming…
– Issues based e.g. traffic congestion, efficient energy, timely supply…
 A Smarter Planet is full of devices
– Data is generated *outside* the enterprise
• Typically very large numbers of devices:
• Often concentrator technology; differentiate, integrate & forward
– MQTT for standards based device integration
IBM is working with Brisbane,
• Small footprint client, embeddable, Low bandwidth cost
London, Singapore and Stockholm
• Fragile network support for hostile environments
to deploy smarter traffic systems.
Stockholm has seen approximately
20 percent less traffic, a 12 percent
 MB to Connect Devices, Apply Intelligence
drop in emissions and a reported
40,000 additional daily users of
– Connects MQTT devices to enterprise systems
public transportation.
– Apply intelligence in near real-time; systems tend to be passive today
 Typical Customers
– US Medical and Technology services company monitors pacemakers for home health
– Swedish city congestion charging, traffic calming and pollution reduction
14 © 2010 IBM CorporationWebSphere User Group
Get the Most from Packaged Applications
Provide broad access to EIS systems
Move information to and from packaged systems
 Packaged Applications Provide Best of Breed Business Function
– SAP for purchasing, sales, inventory…
– SEBL for Sales, PeopleSoft for HR
– Oracle, JDEdwards…etc
 Interfaces are often non standard: e.g. SAP BAPIs, IDOCs
– Processing and data are isolated from other applications
– Result: packaged apps have difficultly using/generating information for other apps
– Inhibits adoption of a best of breed philosophy
 Support for SAP, SEBL, PeopleSoft, JDEdwards… inbound and outbound
– Connectivity built-in – no extra moving parts
– Drive new work into its packaged application from any other supported source
– Can send information from packaged application to any other supported target
– Packaged applications can focus on what they do best and be integrated
 Typical customers
– NA Railroad uses MB for all SAP to SAP communication
– WW Pharmaceutical uses MB for order payment to SAP and distribution notification from SAP
– WW Hotel chain uses MB for SEBL customer billing and sales systems
15 © 2010 IBM CorporationWebSphere User Group
Distribute Database Information to Where It’s Needed!
Distribute database updates to where they’re needed
Provide timely access to changed database information
Move to near real-time data trickle from infrequent ETL extract
 Database Node allows tables to be treated as input source
– Typical scenarios include database to queue & file, or PubSub data distribution
– Captures database changes (Insert Update, Delete) to trigger connectivity processing
– Supports single and multiple tables, complex joins, and other database oriented semantics
– Extends existing database capabilities in MB to provide comprehensive inbound & outbound support
– Works with full range of broker databases including Oracle, DB2, SQL server, solidDB and more…
• Most existing Event table and data table structures supported without database change
– RAD tools construct skeleton database queries to simplify user experience
• Power users can create sophisticated SQL routines if required or desired
Event
Table
3.Polling
 Fully Transactional with High Performance and Scalability 2.Database
Notification
4.Read
trigger
Event
– Distinct event cache & data transactions minimizes contention
7.Delete
1.Table
Event
– Exploits SQL engine for full 2PC transactions
update
5.Get 6.Propagate
User Database
Data Data
Table Processor
 Typical Customers
– German Distributor captures order updates for downstream systems notification
– French Food manufacturer for timely notification of database updates to SAP
• Uses MB SAP connectivity and database support
16 © 2010 IBM CorporationWebSphere User Group
Provide a PEP for Secure Application Connectivity
Provide secure access (AAA) to applications and services
Understand and convert broad range of security domain identities
Provide secure external access services to partners
 Connectivity often implies security domain change
– MB supports a broad variety of security tokens
– Userid/pw, X509, SAML, Kerberos, LTPA…
 MB is Policy Enforcement Point (PEP)
– Security is enforced here, still owned by PDP
– Identity management, access control, authorization
and authentication mechanisms (AAA) are essential
 Policy Decision Point (PDP) and MB work together
– PDP combination provides a secure infrastructure
– Ensures conformance to centralized security policy
– Many different PDP technologies supported
• Lightweight Directory Access Protocol (LDAP)
Microsoft Active Directory, Open LDAP…
• Tivoli Federated Identity Manager (TFIM)
• WS-Trust, zOS SAF including RACF
 External Partner Access to Services
– DP security hardened DMZ device strengths
17 © 2010 IBM Corporation
– Combine network and MB functionalityWebSphere User Group
Make an Application Inventory & Govern Processing
Understand your application assets and control their access dynamically
Dynamically change processing without redeployment
Provide processing policy and governance
 Catalog application and service assets using a registry, e.g. WSRR
– Web Service and MQ Service definitions
– Classifications: by function, owning department
– Relationships: applications dependencies for lifecycle management, versioning
– User defined properties (metadata): Application=GOLD or Service=SILVER
Service
Provider
 Use registry information in MB routing
Use metadata to
– Built-in MB facilities allow access registry
implement ‘smart’
mediations
• In memory cache for high performance
3
• Automatic change invalidation
Virtual
Service
– Enables policy based processing, examples
• Simple routing based on client metadata
Service 1
• Dynamic WS-SecurityPolicy processing
A
A’
Requestor
• Dynamic transformation based on endpoint Capture metadata
2
about services for
Advertise
– WSRR as critical governance point use by Service Bus
availability of
the ‘virtual
services’
 Typical Customers
– US automotive sales company uses MB+WSRR
• Timely match vehicle availability with customer request
18 © 2010 IBM CorporationWebSphere User Group
Monitor Your Business and Act Intelligently
Understand the business relevance of MB data
Apply business rules to MB data in-flight
Detect business situations and act quickly
 MB Connectivity Processes Events from many Sources, Targets
– Capture business relevant information for WebSphere Business Monitor
• Examples: total dollar trade value per day, orders per hour
– Capture business events to correlation with WebSphere Business Events
• Look for correlations in data, e.g. fraud, sales opportunities, CRM
– Audit, Repair and Replay transported events
ILOG rules
engine
 Generate Business Monitoring Events from existing connectivity
– Enables integration with WebSphere Monitor to display & analyze KPIs
– Design time and operational time event activation
– Notification via CEI & Publish subscribe
Outputs
Inputs
 Rule-based Decision Services render decisions on input data
– Most often this data comes from a variety of data sources: aggregation, transformation is required
– Rule-based Decision Services send outcome decisions to other systems: rule based routing
 Typical Customers
– European Motor manufacturer creates virtual system of record for audit
– NA Insurance company uses MB+ILOG for business decisions routing
– UK Retail group measures store throughput by item for real-time trending
19 © 2010 IBM CorporationWebSphere User Group
Detect and Act Upon Business Events
Business Process
Identify a diverse range of business events and act
Compose existing applications and services to create new value
MB
 MB Event Capture and Process Initiation
– Breadth of MB connectivity enables multiple business process starting points In : Events
• Identify event and initiate business process
• e.g. message, file, web service, devices can start business process
– Synchronous & asynchronous invocation for short & long running transactions
• Multiple options with Process Server, Lombardi, FileNet…
 Integration with WBE to Identify Business Event
– WBE allows multiple MB events to form single business event
Out : Evaluations, Correlations
– e.g. duplicates => fraud, missing event => SLA not met
 Business Process Connectivity
Business Process
– Exploit range of MB connectivity to abstract and simplify BPM
– Process focus on WHAT rather than MB focus on WHERE, HOW concerns
– MB receives service request and routes, re-formats, interacts with provider
MB
Web Service, SAP, MQ, File…
20 © 2010 IBM CorporationWebSphere User Group
IBM Healthcare Technical Architecture
Non-Trust Applications
Home/Telehealth
Medical Devices
Portal
Web Services
Web
Hospital
Clinical Pathway Management –
Services
Medical
Emergency, Oncology etc
Devices
Web
ebXML
Services
ITK
IBM Remote
Proprietary
Electronic Forms -
Medical
Device
Discharge Form etc
Web
Aggregator
Services
Web Services XML
Integration Engine – WebSphere Message Broker
Integration Engine - ESB
XML, SOAP, Web
ODBC, JDBC, SQL XML, IDOC, Proprietary XML, HL72, HL73, Cache ODBC, HL72 HL72, HL73
Services, ebRIM
Web Services Proprietary
JCAPS
Enterprise
Rhapsody
Data eGate
InterSystems
Warehouse
Clinical Applications Electronic
Corporate Existing Clinical
Applications PAS – Orders – Pharmacy – Hospital Document Master
Analytics and Reporting
Maternity – Pathology – ER Integration Sharing Patient
Clinical and Corporate
Billing – Payroll - HR Engine Index
2 21 1 © 2010 IBM Corporation
Authentication and Single Sign OnWebSphere User Group
Business Relevant ESB Connectivity
Industry Specific Extensions, e.g. Healthcare
Built-in Patterns to solve relevant connectivity problems quickly e.g. HL7 Connectivity
Domain Specific Tooling to allow users to focus on appropriate details
 IBM ESB for Healthcare
– New facilities for connecting HL7 clinical applications, with end-user operational tooling
– Typical scenarios include device integration, electronic forms, clinical document sharing, analytics…
– Built-in & customizable patterns to enable rapid creation of common healthcare connectivity scenarios
 Clinical Applications Support
– New built-in input and output connectivity for generic HL7 clinical applications
• EPIC, Cerner (Admissions, Discharge, Demographics), JAC, Sunquest, IHE, MediTech
– New Patterns Explorer Healthcare category contains common connectivity patterns
• e.g. HL7 pattern has sequencing, duplicate detection, journaling, remainder processing built-in
• Exploits HL7 V2.x Common Information Model (CIM)
– Users can extend built-in patterns and create their own healthcare patterns
 Operational Tooling
– Provides end-user view for status and statistics
– Clinical application reporting and monitoring
2 22 2 © 2010 IBM CorporationWebSphere User Group
Develop & Reuse Solutions with Patterns
Develop connectivity solutions quickly
Capture previous experience for cost reduction
Ensure solutions conform to best practices
 Use MB’s built-in Patterns to Kick-start Development
– Built-in patterns for Web Services, Messaging, File, SAP...
– Guided solutions using top-down, parameterized approach
– Development artefacts are generated from solution template
 Create your own Patterns to suit your Business needs
– Simple to create your own solution template – User patterns!
– Start from an existing Message Broker solution or IBM pattern
– Ensure specific business: e.g. audit, notification, validation…
 Create and Participate in Public and Private Communities
– Create reusable assets for sharing across your business
– Full check-in/out & versioning with any Library Control System
– Private Communities for internal sharing via Web Content tools
– Public communities for more widely available patterns
 Typical Customers
– Swedish partner providing patterns for low cost off-premises connectivity
– WW GSI using patterns for quicker time-to-value and cost reduction
– mqseries.net public patterns community launched Nov 2010
• Patterns created, rated & used by mqseries.net community
23 © 2010 IBM CorporationWebSphere User Group
configure deploy
Move your MB into the Cloud
HVE
Config
Provision new system instances quickly
pattern
Grow your infrastructure to meet demand
Easily manage multiple deployments
 A new feature to simplify provisioning of your MB
– Initial system deploy resulting in quicker time to solution value
– Fix pack deploy reduces recurring maintenance cost
 Hypervisor Edition Packages
– Pre-built installed VM image for OS+HW combination
– Updated when new fix pack levels released
 Option to Deploy & Manage with WebSphere Cloudburst Appliance
– Repeatable configurations using patterns and scripts
– Base WCA Pattern for most popular configurations
– Script Packages configure base pattern
– Emergency fixes also possible
 Fully functional deployed configuration
– Interactions with MB no different to regular environments
24 © 2010 IBM CorporationWebSphere User Group
Message Broker Product Roadmap
IBM's plans, directions, and intent are subject to change or withdrawal
 Healthcare Connectivity
Pack Update
 Product & pre-requisites simplification
 Patterns & Impact Analysis
 Integrated MQ Pub-sub
FixPack 2
 PHP support
Q4 2012
 MB Explorer & advanced administration
VNext (8.0)
 Web Services SCA Interoperability
FixPack 1
Q4 2011
Q2 2012
 Advanced management facilities
Healthcare
 Enhanced SAP, SEBL, PSOFT support
Connectivity
 Simple & Productive
 SFTP support for file nodes
Pack V7.0
 Universal & Independent
Q1 2011
 Industry Specific & Relevant
V7.0.0.3
Hypervisor
 Dynamic & Managed
FixPack
Edition V7.0
 High Performing & Scalable
Q2 2011
Q4 2011
V7.0.0.2
 HL7 Application connectors
FixPack
 HL7 Connectivity Patterns
Q4 2010
V7.0
 Operational Management Tooling
Nov 2009
V7.0.0.1
FixPack
Q2 2010
Major release
Minor release
25 © 2010 IBM CorporationWebSphere User Group
Message Broker Next Release
 Message Broker Next Release
– Themes & Candidate Line Items well understood and verified
– Early Programs started Jan 2011 will run throughout year
• Please contact David Hardcastle or Anthony O’Dowd for more details
– Release Content heavily influenced by user requirements, participation and feedback
– Continuous rollout beyond general availability
 Themes for Diverse Connectivity Requirements
– Simple & Productive
– Universal & Independent
– Industry Specific & Relevant
– Managed & Dynamic
– High Performing & Scalable
 Message Broker is a key IBM connectivity technology
– Unparalleled range of connectivity options and capabilities
– Supports users’ range of experience & needs
– Industry leading performance in a broad range of scenarios
26 © 2010 IBM Corporation