Managing WebSphere MQ as a Service - Insider Technologies Limited

sweetleafapartInternet και Εφαρμογές Web

7 Αυγ 2012 (πριν από 4 χρόνια και 10 μήνες)

435 εμφανίσεις

BITUG April 2009

Managing WebSphere MQ as a Service

Dave Shields

Principal Consultant

Insider Technologies Limited

Monitoring MQ as a Service

NSK

UNIX

WINDOWS

Reflex 80:20

Extraction

Layer

Extraction

Layer

Extraction

Layer

Sentra

Reaction

Engine

Rules Engine

“Alerts, Thresholds, Availability,

Throughput, Events, Compatative Analysis”

Extraction Layers monitor MQ environment

MQ Messages

IBM

Extraction

Layer


Overview of Insider Technologies


HP NonStop MQ Object Management


WebSphere MQ Management

www.insidertech.co.uk


HP Business Partner


Microsoft Certified Solutions Partner


Software Integrators (International
Payments, COPE & STAR)


Logica


HP in Secure Messaging

Partnerships


Established in October 1989


Two original partners


Privately owned

Insider Technologies



The Company

Markets


Financial

retail and wholesale banking


Many derived through our original Tandem
(now HP NonStop) systems management
products


Architecture now based on high
-
end
windows servers with web access and SQL
Server

Formal Quality
Methodology


ITL has ISO 9001 TickIT accreditation


One of the first UK companies to obtain
ISO 9001/2000 (now /2008 certified)


Everything we do is now within this
framework


Company intranet is referenced by DNV
(Det Norske Veritas) as a “leading edge
example of making Quality programmes
pay”


Two main products developed for HP NonStop:


MultiBatch


Reflex 80:20


Company Overview

MultiBatch

Reflex 80:20

Embracing more Open Technologies


Insider expanded into cross
-
platform

application development,

encompassing:


Win32 and Web


Solaris / Unix / OSS


Linux



Insider continues to evolve

NonStop technologies,

such as RTLX Reactor


Product portfolio growth


Now includes:


Enterprise Messaging Management and Tracking


Service and Application Management


Provision of Managed Services


Bespoke Development

HP NonStop

MQ Object Monitoring

HP NonStop


Reflex 80:20


Real
-
time, proactive & reactive monitoring


For all NonStop platforms


For all NonStop subsystems


Including the monitoring of:


WebSphere MQ 5.3.1.4 (OSS)


WebSphere MQ 5.3 (Guardian)


Legacy MQ 5.1 (Guardian)

HP NonStop


Reflex 80:20 for WebSphere MQ


Object Monitoring & Management


Autodiscovery of MQ environments


MQ Agent provides MQ object config


Objects receive MQ events


Escalate alerts to:


SMS, Pager, Enterprise Managers, email, SNMP



HP NonStop


Reflex 80:20 for WebSphere MQ


MQ EMS event conversion & monitoring of:


IBM.99.0, event 5


TANDEM.512 (text events)

Reflex 80:20


MQ Object Monitoring


Autodiscovery of WebSphere MQ components


Utilises supplied Reflex macro


Executes RUNMQSC (either for 5.1 or 5.3.1.4)


Obtains MQ Objects


Manager, Queues, Channels


SQL script populates Reflex Status Monitor database


Objects now ready to receive MQ events


Via Reflex GUI, obtain MQ Object Detail


Executes a Reflex Status Agent


Spawns a TACL process to execute RUNMQSC

Reflex 80:20


Autodiscovery




Creates:


Top Level Groups


Sub
-
groups


MQ Objects:


Manager


Queues


Channels

Reflex 80:20


Reflex MQ Agent




Obtains MQ Object Detail via Reflex GUI


Equivalent of RUNMQSC commands:


MQ Queue Manager


display qmgr all


MQ Queue


display queue (<queue name>) all


MQ Channel


display channel (>channel
-
name>) all


display chstatus (<channel
-
name>) all

Reflex 80:20


MQ Object Detail


MQ Queue Manager



Reflex 80:20


MQ Object Detail


MQ Queue




Reflex 80:20


MQ Object Detail


MQ Channel





IBM.99.0, event 5
” EMS events


Earlier release of MQ issued events with discrete
event tokens


In subsequent versions, relevant information is now
embedded in large text tokens


Manager


Channel


Queue


Error messages now difficult to retrieve, process and
escalate

Fixing one of your major problems


Consider…


Attempting to ping one Channel




Attempting to ping a different Channel




Subject token difficult to process

WebSphere EMQ EMS Event Monitoring


Relevant information placed into text token

WebSphere MQ EMS Event Monitoring

SSID

Same event Number for different information

Event Text including

relevant information

such as Channel

MQ Error code


Purpose built to scan MQ events


Retrieves nominated MQ events from a chosen

EMS collector


Utilises config file to create a second event in $0


Extracts any attribute names from body of original MQ
event text


Uses these attributes as discrete tokens in the new event


MQ Manager, MQ Channel, MQ Queue


As discreet Manager & Subject tokens


For this release, utility processes event IBM.99.0,

event number 5

Insider’s EMS MQ Gateway


IBM MQ error code is embedded within text
token:


Prefixed by the letters “AMQ”, e.g. AMQ
9512


Error code (
9512
) is extracted:


Utilised as the new event number


Any relevant info such as Channel, is used as a separate
event token


Any MQ TANDEM.EMS.0.512 (text) events:


Error code, prefixed by “AMQ” is used as the new

event number

Insider EMS MQ Gateway


Result:


Original IBM event:




Becomes unique tokenised events:




New subject tokens easier to process & escalate


Development underway for unique event numbers

Insider EMS MQ Gateway


Better management of events


Via Reflex 80:20

Insider EMS MQ Gateway

Or via your own

Enterprise Manager

WebSphere MQ

Management


Because MQ usually connects
disparate platforms

Monitoring MQ as a Service

NSK

UNIX

WINDOWS

Extraction

Layer

Extraction

Layer

Extraction

Layer

Sentra

Reaction

Engine

Rules Engine

“Alerts, Thresholds, Availability,

Throughput, Events, Compatative Analysis”

Extraction Layers monitor MQ environment

MQ Messages

IBM

Extraction

Layer

Sentra for WebSphere MQ

Monitoring things that “flow”



Monitors (some examples):


WebSphere MQ


Payments


Events


Messages


Infrastructure


Logs


Directories


Etc…

Sentra for WebSphere MQ


Single web
-
based console


Auto
-
detects MQ configurations


Extraction Layer runs on MQ platforms


Forwards data to Sentra Server


Utilises Standard MQ API


XML Development

Sentra for WebSphere MQ


Extraction Layers available for:


HP NonStop


Unix


Linux


Windows

Sentra for WebSphere MQ


Sentra Server Database:


Microsoft SQL


Stored Procedures


MIS Reports


Rules


Tasks

Sentra for WebSphere MQ


Sentra WebSphere MQ Rules


Drives Thresholds, Dashboards, Alerts


Queue Manager, Queue, Channel
-

Stopped / Paused


Queue Depth Threshold Exceeded


Queue Time Threshold Exceeded


Message Time Exceeded


MQ Specific NSK EMS events


MQ Specific Windows Event Log Errors


MQ Specific Unix Syslog Error Messages

Sentra for WebSphere MQ


Data is analysed & processed to produce:


Graphs, Charts, Dashboards


Hypervisor Views, Alerts, Reports


Query engine

The SENTRA Architecture

Data
Source

Schema

Store
/

Fwd

Reaction

Engine

Xfer

Mech

Real Time

Data
Source

Schema

Store
/

Fwd

Reaction

Engine

Xfer

Mech

SENTRA Product

Extraction Layer

Less than 5% impact on tracking applications

New XML
-
based extraction subsystem

The SENTRA Architecture

Schema

Store
/

Fwd

Reaction

Engine

Xfer

Mech

SENTRA Product

Consists of:



SQL Server Database



Web
-
based, rules and visualisation layer



IIS
-
based automated reporting

The SENTRA Architecture

Data
Source


Hypervisor Views


Example of a

top
-
level view

including

WebSphere MQ

Sentra for WebSphere MQ


Hypervisor Views


Drill
-
down into

lower
-
level views:


Dashboards


Charts


Alerts

Dead
-
Letter Queue Status
(by Queue Manager)

MQ Message
Throughput

Sentra for WebSphere MQ


Further granularity


Display Message

details


Execute Tasks

Messages currently in Dead
Letter Queue for selected
Queue Manager

Sentra for WebSphere MQ

Sentra for WebSphere MQ


Alerts View


Rules Based


Escalate


Display Message detail

Sentra for WebSphere MQ


Execute Tasks

Sentra for WebSphere MQ


Status of:


Queues


Messages in Queue

Sentra for WebSphere MQ


Status of:


Channels

Sentra for WebSphere MQ


EMS Event Query


Search for events, based on filter criteria


Save query for repeated use


Pre
-
configured Rules


Drives Hypervisor Alerts


Escalate via ‘Actions’, run tasks, scripts


Incorporate:


Cause


Effect


Recovery

Sentra for WebSphere MQ


XML Monitoring


Load XML or XSD file from WebSphere MQ


Also from TCP/IP or File Source


Select appropriate XML fields for rules creation


E.G. 10% drop in transactions in last 20 minutes


Parses XML fields to:


Automatically create Sentra SQL tables


Sentra for WebSphere MQ


XML Monitoring


XML agents deployed to key monitoring points


Monitor transaction volumes and trends


Payment volumes & trends


End
-
to
-
end processing times


Configure rules to monitor:


SLA compliance


Abnormal processing volumes


Sentra for WebSphere MQ


XML Monitoring


View XML topology


Select required field elements


Configure rules, charts & dashboards

Sentra for WebSphere MQ


XML MQ Queries


Query on MQ Payments

Sentra for WebSphere MQ


XML MQ Queries


Obtain transaction details

Sentra for WebSphere MQ

www.insidertech.co.uk

Tel: +44 (0)161 876 6606