DB2 Real-Time Analytics Meeting Wayne, PA 2015 - IDAA & DB2 Tools Update

DB2 for z/OS Real-Time Analytics
IDAA and IBM DB2 Tools Update
1
Baha Majid
IBM Senior Certified IT Specialist
bmajid@us.ibm.com
October 2015

2
Disclaimer
– Information regarding potential future products is
intended to outline our general product direction
and it should not be relied on in making a
purchasing decision. The information mentioned
regarding potential future products is not a
commitment, promise, or legal obligation to deliver
any material, code or functionality. Information
about potential future products may not be
incorporated into any contract. The development,
release, and timing of any future features or
functionality described for our products remains at
our sole discretion.

AGENDA
 IBM Strategy
 DB2 Tools & Solution Packs
Performance Solution Pack
Utilities Solution Pack
Fast Recover Solution Pack
Administration Solution Pack
 IBM DB2 Analytics Accelerator (IDAA)
 IDAA Loader
 QMF for z/OS
 Closing

DB2 Tools and Utilities Tools Strategy
 Address customer needs, today and into the future
 Support core function & new technology
 Reduce CPU, ET & resource consumption
 Maximize availability
 Remove constraints & limitations
 Simplify data management
 Augment support with Tools
 DB2 Utilities Solution Pack (e.g. DB2 Sort, Utility Enhancement Tool)
4

5
Understanding Analytics
 The goal of analytics is to
deliver greater insight to
the business to maximize
business performance
 Analytics are only as good
as the underlying data
foundation
Query Acceleration
Information Management
Foundation
InformationManagementTools
Replication
Business Analytic Landscape
Reporting
Ad-Hoc
Analysis
Statistical
Analysis
Predictive
Analytics&
Forecasting

6
DB2 for z/OS Tools Portfolio
DB2 Utilities Solution Pack
for z/OS
DB2 High Performance Unload
DB2 Sort
DB2 Automation Tool
DB2 Utilities Enhancement Tool
DB2 Fast Copy Solution Pack
for z/OS
DB2 Recovery Expert
DB2 Cloning Tool
DB2 Performance Solution Pack
for z/OS
OM XE for DB2 Performance Expert
DB2 Query Monitor
DB2 SQL Performance Analyzer
Optim Query Workload Tuner
DB2 Administration Solution
Pack for z/OS
DB2 Administration Tool
DB2 Object Comparison Tool
DB2 Table Editor
Optim Configuration Manager
DB2 Administration Toolkit SAP Edition
Data Studio
Database
Administration
DB2 Utilities Suite
DB2 Automation Toolkit SAP Edition
Utilities
Management
DB2 Log Analysis Tool
DB2 Change Accumulation Tool
DB2 Object Restore Tool
Application Recovery Tool for IMS and DB2 Databases
Backup and
Recovery
Optim Query Capture and Replay for DB2 on z/OS
DB2 Path Checker
DB2 Bind Manager
InfoSphere Data Architect
Testing and
Migration
Management
Business Analytics
and Data
Warehousing
Cognos Business Intelligence for z/OS
Cognos Business Intelligence for Linux on System z
SPSS for Linux on System z
DB2 Query Management Facility (QMF)
DB2 Analytics Accelerator
Performance
Management
OMEGAMON XE for DB2 Performance Monitor
DB2 Buffer Pool Analyzer
DB2 Performance Toolkit SAP Edition
Optim pureQuery Runtime
Transaction Analysis Workbench
Information
Governance
InfoSphere Guardium
InfoSphere Optim Data Growth
InfoSphere Optim Data Privacy
InfoSphere Optim Test Data Management
InfoSphere Guardium S-Tap for DB2
IBM Tools Base for z/OS
Information
Integration
InfoSphere Information Server Enterprise Edition
InfoSphere Information Server for Data Integration
InfoSphere Information Server for Data Quality
InfoSphere Information Server for Business
Information Exchange
InfoSphere Data Replication for DB2 for z/OS
InfoSphere Classic Federation Server
InfoSphere Classic Data Event Publisher for z/OS
InfoSphere Classic Replication Server for z/OS

8
Why Solution Packs?
 Simplified offerings in key solution areas:
 Database Administration
 Utilities Management
 Performance Management
 Fast Copy
 Value:
 Complete solution for all needs rather than having to purchase
multiple products (one trip through Procurement)
 Simplified install and maintenance
 Build intelligence into when and how actions are performed
 Optimize performance and resource utilization associated with
DBA activities to reduce TCO
Functional integration / Improved productivity

9
IBM DB2 Tools Solution Packs
DB2
Administration
Solution Pack
DB2
Utilities
Solution Pack
DB2
Fast Copy
Solution Pack
DB2
Performance
Solution Pack
o DB2 Administration
Tool
o DB2 Object
Comparison Tool
o DB2 Table Editor
o Optim Configuration
Manager
o Tivoli OMEGAMON XE
for DB2 Performance
Expert
o DB2 Query Monitor
o DB2 SQL Performance
Analyzer
o Optim Query
Workload Tuner
o DB2 Sort
o DB2 Utilities
Enhancement Tool
o DB2 Automation Tool
o DB2 High Performance
Unload
o DB2 Recovery Expert
o DB2 Cloning Tool
http://www-01.ibm.com/software/data/db2/zos/tools/

10
DB2 Performance Solution
 Integrate business priorities directly
 Monitor KPIs to better reflect end user experience
 Monitor and report on transaction response-time service
objectives
 Allocate resources according to business priorities
 Improve application performance
 Get query recommendations, optimize statistics, create
appropriate indexes
 Optimize results for entire workloads, not just single queries
 Prevent performance problems before they occur
 Use performance data for pre-emptive analysis
and capacity planning
 Identify query hot spots, tune queries, and validate results
 Ensure SLAs and user satisfaction are achieved
 Pinpoint and isolate problems to correct instantly
1. IDENTIFY1. IDENTIFY
2. DIAGNOSE2. DIAGNOSE
3. SOLVE3. SOLVE
4. PREVENT4. PREVENT

11
DB2 Performance Solution Pack
 Tivoli OMEGAMON XE for DB2 Performance
Expert for z/OS
 Full range system and application monitoring
 Detailed reporting and performance warehouse with
integrated real-time monitor and Extended Insight
feature
 DB2 Query Monitor for z/OS
 Dedicated SQL monitoring
 Current and historical views of query detail throughout
DB2 subsystems with ability to set alerts for early
warning
 Optim Query Workload Tuner for DB2 for
z/OS
 Eclipse-based SQL performance analysis
 Enables visualization of query hotspots and includes
expert advisors to provide tuning recommendations
 DB2 SQL Performance Analyzer for z/OS
 z/OS-based SQL performance analysis
 Cost estimate and explain function with “what if” analysis
Identify, diagnose
solve & prevent
DB2 Performance
Solution
More companies
are facing growth of
data volume, but
not staff. Need:
•Smarter approach
w/ less resources
•Proactively optimize
performance
•Keep up more w/
users, growing&
changing requests
“Improving
the bottom-line”

12
Where is my DB2 application spending its time?
 OMEGAMON PE’s Extended Insight - an advanced way to monitor the
database workload (SQL) of your applications and solutions
 Get total response times and response time breakdown (appl,
driver, network, data server) per defined workload/cluster (e.g. per
system, application, user)
 Compare workload from various servers / applications
 Select a time period for analysis
 Get top SQL statements per workload
 Identify top clients contributing
in the workload
Operating
System
DB2
Network
JCC driver
WebSphere or
Java App Server
Application
User
SQL 1 SQL 2 COMMIT
User experience
transaction
App pre- and post-processing

Enhanced 3270 Interface
13
 Easier navigation and fewer screen
interactions to accomplish tasks, instead of a
series of green screens to gather and display
information,.
 Transactions can be linked across multiple
sysplexes; no need to move between multiple
screens and monitors.
 Centralized management environment (Tivoli
OMEGAMON Manager) from which various
activities can be launched
 Color highlighting to flag problems for quicker
resolution.
 TEPS like consolidated data across entire
OMEGAMON family
z/OS-wide
sysplex view
Customize
Views
e-3270 is a “green screen” GUI that provides an enterprise view of
information supported across the entire OMEGAMON family.
“To us, these new IBM 3270 screens accomplish functionally the same thing as their GUI equivalents. The 3270 “graphical “green screen”
approach offers the same information that a GUI screen offers — only displayed slightly differently. What IBM has done with its “GUI on a
green screen” is it has allowed some mainframe managers to stay within their 3270 comfort zone while getting the same display benefits
that GUI mainframe managers get using graphically-oriented products “ – Clabby Analytics
Enterprise management summary can be created that shows
what is happening across all active Sysplexes

14
Cross Product Linking
Embedded Data and Cross Product Linking with OMEGAMON XE
for CICS
 CICS embedded data in a sub panel in DB2 thread workspaces and CICS RCT
 Summary workspace
 Zoom items to navigate directly to CICS workspaces
 OMEGAMON XE for CICS must be installed and configured to the same ITM
environment
 CICS agent is running and reporting to the same ITM environment

15
As a DBA, when I'm analyzing threads, I'm interested to navigate from the E3270UI Thread
Detail screens to the QM SQL Activity to further analyze SQL performance problems,
additional information about the object associated with the thread and statement.
Zoom on "Active SQL Count" (provided
by Query Monitor imbedded in the
OMEGAMON DB2 screen) seamlessly to
the Query Monitor screen below.
Cross Product Linking
Embedded Data and Cross Product Linking with DB2 Query Monitor

16
SQL Text in the Enhanced 3270
Helps you to simplify problem identification and resolution

17
Thread Accelerator Activity in the Enhanced 3270
Thread
Accelerator
Activity
Summary
Thread
Accelerator
Activity Detail

18
Batch Reporting - Accelerator Data
Batch RECTRACE support (“eligibility” & metrics)

19
PE Client – IDAA Support
Dynamic
accelerated
statement
view
Statement
accelerated
flag

20
Batch RECTRACE (IFCID 2) - Accelerator Data

21
OMEGAMON for DB2
What can you save using the Analytics Accelerator?

What’s New in DB2 Query Monitor V3.2?
 Support new features of DB2 11
 Use of zIIP processors to lower cost of monitoring
 Collector code path optimization
 New OPTKEY – PTEXT
 Strip literals and multiple blanks from the summary text
 Additional delay statistics on Object panel
 Lock, Latch, Page Latch, Synchronization I/O delays
 Sort and detect which object is having a delay problem
 New operational commands
 Easier to automate the changing of the monitoring profile
 Compare workloads in the activity browser
 Baseline to another workload
 Detect and analyze different kinds of changes
22

What’s New in DB2 Query Monitor V3.2?
 Share user configurations
 CAE Browser interface
 Filters, archive connections, staging table connection, baselines
 Export activity browser data  PDF or CSV
 LOAD utility support for offload
 New batch reports
 Based on QMF
 Customizable
 Averages based on execution counts
 AVGX elapse, CPU, GETPAGES, Delays
 For better compatibility with the OQWT
23

24
Display information about Accelerator-eligible
queries
The above example shows that you do ‘have Accelerator eligible workload’ on this DB2 and if you had an
IDAA Accelerator you would save ~84% CPU overhead and ~91% in Elapse time for that workload.
User can drill down to plan, program, SQL or Object to view each perspective of eligible savings when using
Accelerator. The Object perspective will show which Objects would need to be moved to Accelerator.

25
Use of QM to identify Accelerated queries

26
Identify, Compare and Segregate Accelerated Queries
with DB2 Query Monitor for z/OS
 Ability to visualize DB2 Analytics
Accelerator queries via
multiple user interfaces (GUI/ISPF)
 Provides measurable performance
comparisons to show ROI
justification for accelerated
queries
 Provides filtering to let you see
both accelerated and
non-accelerated queries to aid
in tuning efforts
Query Segregation screen in ISPF
Activity by SQL Text screen in web client

27
Query Monitor – Export Data

28
DB2 Tools Customizer (TCz) – QM customization
 Standardizes QM with other tools install process
 Builds all necessary jobs to install/configure QM

29
Optim Query Workload Tuner’s “IDAA Advisor”
Workload Analytics Acceleration Advisor (WAAA)
Benefit and Value
 Operates on a workload basis
• DB2 QM and OMEGAMON for DB2 are fantastic input sources
 Identifies SQL statements that are eligible for acceleration
 Provides recommendations on candidate tables to accelerate
 Quantifies CPU savings if those tables are accelerated
 Explains why SQL statements aren’t eligible and how they could be
rewritten to become eligible
 Can recommend which tables should be removed from the
Accelerator

30
Query Selection, Access Plan and Workload Analysis,
Tuning with QWT
 Enhance your ability to select the best
queries to be accelerated
 Visualize access plans of
accelerated queries
 Perform workload analysis to
recommend what objects should be
added/deleted from query table
selection which will result in
CPU and Elapsed Time savings
“ACCELERATED” node shown
in Access Plan Graph (with
access plan details below)

31
 During DB2 utilities sort processing, reduce CPU usage
and elapsed time by up to 50% (using zIIP engines)
 Eliminate ALL CPU and elapsed time by avoiding
unnecessary utility processing?
 Set it and forget it, adjust to fit changing needs
 Use the fastest and most flexible unload in the market to
modernize your data movement
 Set company-wide DB2 utility standards
 Enforced and auditable
 Standardize utility control cards
 ONE change to embedded DB2 Utility JCL can find
and update every occurrence in every application with
the most current version of DB2 for z/OS
1. MANAGE1. MANAGE
2. OPTIMIZE2. OPTIMIZE
3. AUTOMATE3. AUTOMATE
4. CONTROL4. CONTROL

32
 DB2 Sort for z/OS
 Optimizes overall system efficiency by optimizing
resources
 Balances utilization of central storage and disk space to
optimize appropriately
 Allocates storage based on system resources to
optimize memory usage
 Additional zIIP offload to lower CPU consumption
 DB2 High Performance Unload for z/OS
 Runs outside of DB2, so does not consume competing
resources
 Supports efficient migration from non-IBM tools
 Can invoke DB2 Sort to reduce CPU usage and elapsed
time
during utility sort processing
 Increased support for image copies using partitions,
including one output file per partition when using a global
full image copy
Optimize, control
manage & automate
DB2 Utilities
Solution Pack
How do we get the
best control over
DB2 utility
processing?
How do we save
CPU & Elapsed time
while improving
availability?
How do we do smart
automation for DB2
utilities execution?
Optimize, control
manage & automate
DB2 Utilities
Solution
How do we get the
best control over
DB2 utility
processing?
How do we save
CPU & Elapsed time
while improving
availability?
How can we smartly
automate our DB2
“More data,
reduce costs”

33
 DB2 Utilities Enhancement Tool for z/OS
 Extend capabilities of IBM DB2 utilities
 Utility Syntax Monitor
 Establish and maintain company-wide syntax
policies
 Provides auditing
 Ability to cancel and block threads on utility jobs
 Utility Message Monitor to control the return code
 Set it and forget it utility maintenance
 DB2 Automation Tool for z/OS
 Easy to use profiles can set conditions to determine
when or if utility executes
 Improves availability by reducing utility batch window
 REORG avoidance saves system resources, especially
CPU
Optimize, control
manage & automate
DB2 Utilities
Solution Pack
How do we get the
best control over
DB2 utility
processing?
How do we save
CPU & Elapsed time
while improving
availability?
How do we do smart
automation for DB2
Optimize, control
manage & automate
DB2 Utilities
Solution
How do we get the
best control over
DB2 utility
processing?
How do we save
CPU & Elapsed time
while improving
availability?
How can we smartly
automate our DB2
“More data,
reduce costs”

The Growing DB2 z/OS Skills
 Expert DB2 and IMS z/OS skills are dwindling
 Experienced DBAs and SysProgs continue to retire
 New DBAs and SysProgs take years to become “experienced”
 Industry wide – modern employees spend less time in a single role
 Becoming less likely to find as many 25+ year experienced DBAs
and SysProg
 Yet, the need for expert DBA / SysProg skills is growing
 Demands for 24x7 high performance operation continue to increase
 Allowed outage windows are shrinking and are less frequent
 Maintenance done in those windows is more important than ever
 Increasing system complexity makes planning, maintaining, and
troubleshooting more difficult and time consuming
IMS and DB2 DBAs / SysProgs must become more efficient, more quickly
34

The Solution
 Autonomics
 Automate collection of data
 Automate analysis of this data
 Automate decisions based off this analysis
 Automate execution of decisions
 Advanced Graphical Interfaces
 Consolidate and simplify information from various sources
 Simplify the presentation of complex information (visuals)
 Shorten the learning curve (integrated assistance and doc)
 Integration of Tools
 IBM Tools start working together and leverage each others functions
“Sum is greater than the total of its parts”
35

Autonomics Objectives
 Simple to enable & administer
 Central oversight, default profiles, new UI in addition to 3270
 Provide staged enablement through passive then active management
 Individual tables through to entire DB2 environments
 Open and transparent
 DB2 tables, stored procedures, Administrative Scheduler, integration
with batch schedulers
 Extensible with easy integration of other tools and products
 OQWT, performance tools, non-utility actions such as WTOs, SMS
texts
 Preserve investment in Automation Tool, profiles
 Automation Tool profiles & logic for the core of REORG, COPY,
RUNSTATS automation, UET profiles bring in existing batch utilities
36

DB2 Autonomics Director
 Framework for a comprehensive DB2 autonomics environment
 RTS_SNAPSHOT stored procedure – creates a new snapshot of the
current DB2 real time statistics for a data base or a set of objects
 DB2 Active Autonomics Director stored procedure – evaluates a list
of possible actions
 Autonomics
 Passive autonomics – automatically gather real time statistics and
information about the results of running DB2 utilities
 Used to ID potential problem situations and recommend actions
 Active autonomics – utilities are run automatically
 Priority
 Number of tasks
 Time left in the maintenance window
37

IBM Management Console for IMS and DB2 for z/OS
38
DB2 Subsystem
Maintenance Windows
 Progressive drill down
through variety of DB2
object dashboards
 Autonomics Director for DB2
for z/OS (in the no-charge
Tools Base) enables:
– Charting of DB2 object
statistics through RTS
snapshots with
– Autonomics control to define
profiles and maintenance
windows
– Integrated support for the
DB2 Admin Task Scheduler

39
© 2015 IBM Corporation
Management Console - Holistic Dashboards of DB2 Objects
Extended with the DB2 Utilities Solution Pack
…from DB2 Catalog
…from Automation Tool Evaluations
…captured by UET
…recorded by
RTS_SNAPSHOT

40
Management Console – Big Picture

What’s New in DB2 Sort V2.1?
Use of DB2 Sort 2.1 with DB2 utilities, as compared
with running DB2 utilities alone, may see: *
 Reduction of Sort CPU usage
 Up to 84.8% reduction on machines with zIIP engines (49% without zIIP)
 Reduction of Utility CPU usage
 Up to 61% reduction on machines with zIIP engines (40% without zIIP)
 Reduction of Utility Elapsed Time
 Approximately 45% with zIIP engines (46 without zIIP)
41
* The information contained on this slide is distributed AS IS. Performance data and results presented were determined in
various controlled laboratory environments, using specific, limited test configurations, and are for reference purposes only.
Tests were run against the most current versions of DB2 Sort and DB2 Utilities Suite generally available as of October 24th,
2014. Results reported for machines with zIIP engines reflect a situation where all DB2 Sort program zIIP eligible
instructions are successfully dispatched to execute on available zIIP processor(s). The results that may be obtained in
other operating and production environments may vary significantly. Users of the product should verify the applicable
results they might achieve for their specific environment.

42
Customer Challenges & Pain Points
– Reducing CPU usage
– Customer wants to reduce CPU usage overall and increase zIIP
– Chargeback CPU usage to users
– Reducing batch window
– Customer cannot fit objects within batch window for maintenance
– “SORT CAPACITY EXCEEDED” errors during utility processing
– Restarting utility jobs requires manual re-sizing as well as using more system
resources such as CPU
– Customer have large volume of data
– Customers with large volumes of data, large table spaces that are being sorted,
performing large utility sort processing operations involving REORG, LOAD,
RUNSTATS, CHECK, REBUILD INDEX or ANY combination of these utilities
– Reducing Cost of 4 hour window
– Customer runs utilities inside of the 4 hour window
– Additional costs incurred outside of 4 hour window, not sure how much and what
causes the additional costs

43
DB2 Utilities Enhancement Tool – Utility
Extensions
 Extend DB2 Utilities functionality
 LOAD
 CONSTANT/VALUEIF
 PRESORT
 DISCARDTO – flat file
 IFDISCARDS – used to pre-validate
 Validate SYSREC records against the CHECK constraint and data types
 Examine errors  fail the load or pause the load
 REORG
 Automatic sizing and creating of mapping table
 Support for DB2 11 MAPPINGTABLE and MAPPINGDATABASE
 CHECK
 Discard rows to flat file
 Automatically size and creation of discard table

44
 Ensure that unplanned outages do not affect
availability and profits
 Protect critical DB2 for z/OS objects and data with
an recovery insurance policy
 Extensive validity checking guarantees a
complete and accurate backup
 Take advantage of intelligent recovery
 Analyze all resources and provide
optimized cost-based recovery in real time
 Minimize risk of changes in application introducing
costly errors
 Health check functionality validates the
ability to recover to selected points in time
 Eliminate nightly and costly image copies by using
fast replication techniques
1. PROTECT1. PROTECT
2. OPTIMIZE2. OPTIMIZE
3. MODERNIZE3. MODERNIZE
4. CONTROL4. CONTROL

45
 DB2 Recovery Expert for z/OS
 Expert backup and recovery capabilities to
simplify and standardize enterprise-wide
recovery strategy
 Extensive validity checking for backup and
recovery insurance with recommendation for
best recovery plan
 Can leverage fast replication technology for
backup and recovery to maximize application
availability
 DB2 Cloning Tool for z/OS
 Low cost DB2 subsystem and object (dataset)
level cloning/data refresh
 Can use fast replication technology to reduce
production online downtime to seconds when
cloning
Insure, modernize
optimize & protect
DB2 Fast Copy
Solution
CPU Usage almost
eliminated, replacing
costly image copies
with System Level
Backup:
One SLB = multiple
image copies
13 TB processed In
.5 seconds of CPU!
“Protect Data
Eliminate CPU”

46
DB2 Cloning Tool – recent enhancements
• Enables the cloning of an entire DB2 for z/OS subsystem by data sets instead of volume copies
• Reduces manual intervention by automatically handling additional target processes, such as rebuilding
indexes after data masking or log apply processes
• Offers more choices for consistent data sources by adding the capability to clone from image copies or from
system-level backups that are stored on tape
• Increases DB2 for z/OS migration confidence through better support for DB2 for z/OS, V11 object types and
processes
• Implements parallelism to improve throughput when cloning multiple data set objects by processing each
extent of a large object in a separate task
• Offers increased flexibility to accommodate additional utility operations such as CHECK, REBUILD, REORG,
QUIESCE, and RUNSTATS in order to streamline the cloning process

DB2 Recovery Expert DB2 V11 Support!
 DB2 V11 Added Drop Column
 Ability to drop columns from tables via ALTER Statement
 New entry in SYSIBM.SYSPENDINGDDL
 Creates recovery concerns to point in time before ALTER
 Recovery Expert Support:
 Provides automated recovery around DROP COLUMN
 Tracks changes in Schema Level Repository
 Detects if recovery to PIT before alter
– Generates DDL with COLUMN added back in
– Performs recovery using DSN1COPY plus REDO SQL
47

DB2 Recovery Expert DB2 V11 Support
 DB2 V11 Extended RBA/LRSN
 RBA/LRSN expanding from 6 bytes to 10 bytes
 Enhanced to support automatic detection of expanded RBA/LRSN
 Detects if BSDS has been converted. Automatically detects format
 Automatic support for recoveries before or after conversion
 DB2 V11 New Object Type and DDL Attributes
 GLOBAL VARIABLES
 Various DDL Object Attribute Changes
 Tracks new objects and attributes in Schema Level Repository
 Log Based Dropped Object Recovery Support
 DDL will be generated correctly with new attributes
48

49
DB2 Recovery Expert – Recent Enhancements
• Provides users the capability to undo a transaction or transactions
based on selection criteria. Recoveries will be done in a transactionally
consistent manner where all operations of a transaction are undone.
• Allows a recovery to an alternate location. The user will be able to
recover to either another object on the same subsystem or to an object
on a different subsystem. Using this feature, they will be able to
simulate a production problem or test out a recovery solution before
executing it in their production environment.
• Delivers an effective way to prioritize the recovery of applications.
Through the use of application profile groupings, the user can define
and utilize priorities in operations such as creating image copies,
analyzing quiet times, and performing application and disaster
recovery.
• Enhanced system recovery by allowing users to create a Combined
System Level Backup (CSLB) that includes one or more systems from
one or more Database Management Systems (DBMSs)

50
DB2 Administration Solution Pack
 Manage the growth of data and the database without
interruption or risk
 Provide solution that deals with the daily tasks as well
as the unexpected interruptions
 Find problem quickly and solve it even faster
 Address shrinking IT budgets and reduced personnel
 Enable less experienced staff to correctly perform
complex administration tasks
 Reduce errors through automation to allow
skilled users to focus on other tasks
 Reduce the negative impact changes can have on
business
 Minimize impact of changes that affect database,
application and availability
 Standardize and track changes throughout
application lifecycle
1. NAVIGATE1. NAVIGATE
2. MANAGE2. MANAGE
3. TRACK3. TRACK
4. CHANGE4. CHANGE

51
DB2 Administration Solution Pack
 DB2 Administration Tool
 DB2 Catalog navigation
 Migration
 Change management
 DB2 Object Comparison Tool
 Compare DB2 structures
 Generate APPLY jobs
 DB2 Table Editor
 Edit DB2 data values
 Infosphere Optim Configuration Manager
 Explore
 Track change
 Take action
Navigate, manage
change & track
DB2 Administration
Solution
More companies are
coming to IBM as
their ONE DB2 Tools
vendor:
•Investment IBM
makes in DB2 tools
is > than total from
all 3rd party vendors
•Ongoing product
development
•Proven DB2 support
“Limited
Resources”

What’s New in DB2 Administration Tool V11?
 Ability to manage the Analytics Accelerator
 Display / Manage the accelerators
 Start / Stop / Display related accelerated tables
 DET command to display all of the detail information
 Display accelerated tables
 Enable / Disable
 Load
 Run Accelerator functions in batch
 Adding a virtual Accelerator for testing purposes
 Support for DB2 Autonomic functions
 Manage RUNSTATS profiles
 Display alerts
 Manage time windows
52

53
Testing the Accelerator connection

54
Detail information about the Accelerator

What’s New in DB2 Object Comparison Tool V11?
 Exclude specification – can specify objects to be excluded from
 GEN (DDL extraction)
 Compare
 Ignore changes specification
 Provide the ability to specify specific changes which can be ignored
when doing a compare
 May specify a time range
 Improved means of generating a base version before a change or after a
change
 Added --#RESTART identifiers in the work statement list member
 Added CM Batch facility
 Improved masking (global changes)
 Can now mask using the fully qualified object name (3 part name)
 Added more granularity
55

What’s New in DB2 Object Comparison Tool V11?
 Masks, Ignores, Exclude Specifications, Ignore Change Specifications
 Can be stored in DB2 tables
 DB2 Object Comparison Tool report output can be saved and reviewed
from the tool
 Change Propagation
 How do you distribute and track changes to each of your environments?
 Submit multiple jobs? Logon to each target?
 What if object names are different? Which target has the change applied?
 How many environments do you support?
 Do you synchronize the environments?
 What is your time window?
56

What’s New in Change Management?
 Multi-Target Change Propagation
 Register a multi-target change once on a central system
 Easily distribute the change to individual targets or a group of targets
 Automatically via DRDA*
 Register to remote system’s change management database
 Status updates flow back to the central system
 Optionally include masking at each target to adjust for naming
differences
 Each target’s status and the overall status is reflected on the central
system
 One view of where the change has been deployed and applied
57

58
InfoSphere OPTIM Configuration Manager
(OCM)
Client Value
Server Value
• IBM has the only solution
in the marketplace
designed to centrally
manage data clients and
track the configuration
changes to the applications
data clients or servers
while maintaining system
availability and database
integrity.
• Improved operational
efficiency by enforcing
database properties to
conform to established
DBA policies
Centralizes management of database configurations both
servers and clients on z/OS and LUW
GUI Interface
DB2 z/OS 10 & 11

59
Optim Configuration Manager: Key Features
Understand Your
Environment
 Explore client and database
server properties
 Create a baseline inventory
of clients for upgrades
Solve Problems Faster
 Prevent problems by scheduling
configuration compare jobs that
issue Alerts for differences
 Keep configurations in synch
 Debug problems faster by reviewing
recent changes made to client or
server configurations
Centrally Manage Entire DB2
z/OS Environment
 Deploy Location Aliases or
Application Profiles with DB2 for
z/OS v10
 Define zParms with DB2 for z/OS
v9 or DB2 for z/OS v10
 Show changes made via z Admin
Tool and z Admin OC Tool
Control Clients (JCC, CLI, .NET)
 Isolate/Throttle “rogue” Apps to
limit impact on the SYSPLEX
 Enforce best practices
configuration – WLM, WLB, WAS
Pool
 Redirect client connections for
high availability or staged roll-out
Note: With OCM client install

60
InfoSphere Optim Configuration Manager
FUNCTIONS z/OS LUW
Explore data servers, track changes and compare
configurations
 
Explore clients, track changes and compare configurations  
Redirect database connection requests  
Isolate applications; (penalty box, proving ground or
general purpose)

Enforce client properties so that they conform to the
established policies of z/OS Workload Management
Service Classes

Modify properties of deployed database clients and
drivers to achieve optimal workload balancing in the
database
 
(pureScale)
Identify storage optimization opportunities through reclaimed
storage, compression and least used objects


IBM DB2 Analytics Accelerator (IDAA)

62
SPEED
• Dramatically improve query response – up to
2000X faster – to support time-sensitive decisions
• Right-time. Low latency. Trusted. Accurate.
SIMPLICITY
• Simplify infrastructure, reduce ETL and data movement
off-platform
• Non-disruptive installation
SAVINGS
• Minimize data proliferation
• Lower the cost of storing and managing historical data
• Free up compute resources
SECURITY
• Safeguard valuable data under the control and security
of DB2 for z/OS
• Protected. Secured. Governed.
A workload optimized, appliance add-on to DB2 for z/OS that enables the
integration of analytic insights into operational processes to drive business
critical analytics & exceptional business value.
IBM DB2 Analytics Accelerator for z/OS

63
DB2 11 The Foundation for Business Critical Analytics
DB2 for z/OS and
IBM DB2 Analytics Accelerator
OLTP Transactions
Real time data ingestion DB2 Native
Processing
High concurrency
Standard reports
OLAP
Complex queries
• CPU savings benefit
DB2 query workloads
including short running
operational analytics,
and reporting
• DB2 Analytics
Accelerator benefits
data warehouse, OLAP,
and complex query
workloads
Operational analytics

64
IDAA Advisor Scenario
Order by Avg CPU time
Top 10 queries
Capture queries into OQWT
 Start by capturing “Top 10” queries from DB2 Query Monitor (QM)
 Drill down from QM web interface
 Transfer top 10 queries to OQWT as a workload for tuning
64

65
65
Invoke Workload Analytics Acceleration Advisor
Invoke Analytics
Acceleration Advisor

66
Review Accelerator Recommendations
Actual CPU savings from query offloading
Estimated savings from query offloading
Add Recommended Tables to Accelerator
List of tables recommended for offloading
Eligible Statements for offloading
66

67
Review Recommendations – Ineligible SQL
Ineligible Statements for offloading
Display ineligible reasons (QI_DATA)
67

68
Review Recommendations – Rewritable SQL
Display all queries that can be rewritten to become eligible
Non read-only queries can be rewritten by
adding “FOR FETCH ONLY” clause
68

69
Common Accelerator questions

70
DB2 Analytics Accelerator V5.1 - Highlights
Version 5.1 of DB2 Analytics Accelerator opens up a new dimension of analytical
processing by introducing in-database analytics, in-database transformation and
accelerator-only tables:
 In-database analytics capabilities enable acceleration of predictive analytics
applications. This enables SPSS/Netezza Analytics data mining and in-database
modeling to be processed within the Accelerator.
 In-database transformation supports the consolidation of ETL/ELT processing in DB2
for z/OS to enable a more cost-effective, simplified architecture.
 Accelerator-only tables can benefit statistics and analytics tools that use temporary
data for reports. The high velocity of execution enables these tools to quickly gather all
required data.

71
 Load and continuous operation improvements within the incremental update
better support enterprise clients.
 Augmented security and improved performance with new PureData® technology
extend advanced security with encryption of data at rest and of data in motion
while taking advantage of the legendary built-in security of System z®.
 Enhanced systems management capabilities enable faster data synchronization
and data load (incremental update) as well as improved serviceability with
automatic call home capability.
Additional functional highlights new in Version 5.1
(contd.)

72
What‘s new in V4.1 PTF 6
 Continuous Replication:
 Incremental update processing now continues for all enabled tables while
tables are enabled, disabled, loaded or reloaded for replication. This
reduces replication latency, ensures near-realtime availability of replicated
data and keeps DB2 for z/OS tables availabe for business changes.
 DB2 for z/OS 11 support for:
 Accelerator-only-tables for in-database transformation and multi-step
processing
 Caching of accelerated queries in the dynamic statement cache
 New set of statement level monitoring counter
 Supports accelerating queries using the TIMESTAMP_ISO function
 Trace facility enhancements
 The tracing facility has been enhanced to include the output from the
support tool ‚nzlogcollector‘ running on the Accelerator.
 Nzlogcollector collects information for a specific disk or another hardware
component

Accelerator-only tables – Technical basics
 AOTs are created and dropped using DB2 DDL statements (CREATE; DROP)
• Accelerator must be started
• QUERY ACCELERATION behavior may have any value during CREATE/DROP
• Syntax:
 CREATE TABLE MYTABLE (...) IN ACCELERATOR <ACCEL1>;
 DROP TABLE MYTABLE;
 Recommended to create a database in DB2 to be used for the AOTs
• CREATE TABLE MYTABLE (...) IN ACCELERATOR <ACCEL1> IN DATABASE
MYDB;
• Usual authorization necessary to create objects in database
 SELECT and INSERT/UPDATE/DELETE operations using AOTs can only run on the
Accelerator
• QUERY ACCELERATION behavior must be set to ENABLE/ELIGIBLE/ALL
• Accelerator-shadow tables, Accelerator-archived tables and other AOTs can be used
in the same statement
 Dynamic and static SQL can be used with AOTs

Multi-step reporting applications with DB2 for
z/OS
BEFORE Accelerator-only tables: Report processing on DB2, source data
might reside on the Accelerator already
Temporary
results
22
Temporary
results
11
Temporary
results
Reports and Dashboards
nn
Multi-Step Report
nn
11
22
Reporting Application
Credit Card
Transaction History
Customer
Summary Mart
Credit Card
Transaction History
Customer
Summary Mart

Multi-step reporting applications with DB2 for
z/OS
With Accelerator-only tables: Temporary objects and processing on the
Accelerator
Temporary
results
22
Temporary
results
11
Temporary
results
Reports and Dashboards
nn
Multi-Step Report
nn
11
22
Reporting Application
Credit Card
Transaction History
Customer
Summary Mart
Credit Card
Transaction History
Customer
Summary Mart
Data for transactional and analytical processing

In-database transformation
Using Accelerator-only tables and ELT logic in the Accelerator
Transaction Processing
Systems (OLTP)
Analytics
Advantages:
• Simpler to manage
• Better performance and
reduced latency Data for transactional and analytical processing
Customer
Transactions
Customer
Data
Customer Transaction
Summary and History
AOTs
Customer Summary
Mart AOTs
Customer
Transactions
Customer
Data
ELT logic

Data scientist work area
Using Accelerator-only tables for ad-hoc analysis
Systems (OLTP)
Customer
Transactions
Customer
Data
Customer
Transactions
Customer
Data
Work database
John
Work Area
AOTs
Work database
Bob
Work Area
AOTs
Data Scientist John
Data Scientist Bob

Integrate more data sources for analytics
Load external data to the accelerator and save combined analytic results
in accelerator-only tables
Systems (OLTP)
Analytics
Customer
Transactions
Customer
Data
Combined result
in AOTs
Customer
Transactions
Customer
Data
Related
data from
other
sourcesExternal
Files
Image
copy
DB2 Analytics Accelerator Loader

• Deeper insight into operational status through faster reporting
Support multistep reporting applications. Third party BI reporting suites, QMF, home grown applications, etc.
• Simplifying data-transformation processes
Delivering in-database transformation within DB2 Analytics Accelerator
• Data mart consolidation through flexible data infrastructure
Host data marts on z Systems, where the data originates
• Deeper insight into customers and markets
Data scientist work area
• Simpler data integration with DB2 Analytics Accelerator Loader for z/OS (load
non-DB2 for z/OS data)
Assimilate more data sources for analytics to shorten development cycles and speed integration efforts
• In-database analytics to accelerate predictive analytics
Improves the quality of models, speeds calculations and delivers real-time, actionable business processes
What can I do with AOTs?

80
I want to maximize the power of DB2 and
System z for business analytics. How do I
bring Oracle data to the Accelerator for
query optimization?
How do I improve the loading of objects
into DB2 ad/or Accelerator without
impacting my DB2 production data?
80
IBM DB2 Accelerator Loader
 DB2 data
– Loaded in into the accelerator and optionally into DB2
simultaneously
– Loaded without writing a program to invoke the stored
procedure
 Non-DB2 data (IMS, VSAM, non-z/OS data, etc)
– Load into the accelerator without first landing data into
DB2 tables
 Load consistent data or historical data on related
sets of tables

81
Accelerator Loader Use Cases
 External Data Load / Dual Load
– Load Non-DB2 Data, or DB2 data from System z
• Can load data onto the accelerator and optionally into DB2
simultaneously
• Can load non-DB2 data into the accelerator
 Consistent Data Load
– Load related tables or load historical data
• Loaded related sets of data into the accelerator
• Historical data can be loaded into the accelerator to reset
data

82
External Load / Dual Load Functionality

83
Consistent Data Load Functionality

IDAA tooling summary
Surround IBM DB2 Analytics Accelerator with DB2 Tools for z/OS to maximize your
analytics investments and their impact on your business
 Accelerator performance monitoring, analysis and reporting
 OMEGAMON XE for DB2 Performance Expert on z/OS
 Accelerated query identification, comparison and segregation
 DB2 Query Monitor for z/OS
 Query candidate selection, access path visualization and analysis
 InfoSphere Optim Workload Query Tuner for DB2 for z/OS
 Administer your IDAA appliances quickly and easily
 DB2 Administration Tool, DB2 Object Compare, IDAA Loader

86
 Investment protection in QMF objects
(queries, forms, procedures, batch
processes)
 Extend the reach of analytics to more
users: TSO, Workstation, Web, and
Mobile
 Innovation with dashboards, visual
reports, extended graphics and charting
and more
 Modernization of existing QMF
environments
 Standardization on a common BI/BA
platform
 Broad reach to enterprise data: relational,
OLAP, unstructured, Big Data, Excel, IMS
 Data federation and caching
 Drill thru to any available data (e.g. DB2 to
Oracle etc.)
 Dynamarts – encapsulate data within a
report, chart, etc.
 Extended platform support: z/OS,
Windows, Linux, WebSphere anywhere
 High ROI with enterprise-wide deployment
at a fixed cost
 Superior support of the IBM DB2 Analytics
Accelerator
Technical benefits of QMF for z/OS
Data Sources:
All Relational DBs,
Hierarchical DBs,
Unstructured data
Hadoop
BigInsights
Workstation, Tablet, Web
Dashboards,
visual reports,
analytics,
dynamarts
Processes OLAP:
SAP B/W,
MS Analysis Services
Essbase
Data Sources:
Relational DBs:
DB2 LUW,
DB2 iSeries and
DB2 VM/VSE

87
The QMF for z/OS solution components
QMF HPO
• ‘High
Performance
Option’ for QMF
for TSO/CICS is
a multifaceted
tool that helps
database
administrators
manage QMF
objects and
increase
performance in
the TSO and
CICS
environments
QMF for
Workstation
• Extends the key
functionality of
QMF for
TSO/CICS on
distributed
platforms via a
rich desktop
development
environment.
Runs on
Windows,
Linux, and the
Mac
QMF for
WebSphere
• Provides a
feature set
similar to that of
QMF for
Workstation,
using a thin-
client, browser-
based solution
as well as
mobile device
support. Runs
on Windows,
Linux, Solaris,
AIX, HP-UX,
iSeries, z/Linux,
and z/OS
QMF
Analytics for
TSO
• Delivers
unprecedented
charting and
statistical
analysis
capabilities
directly to the
mainframe
QMF for TSO
The ‘core’ component with query, reporting, forms, procs
graphics, with interactive (3270) or batch processing
options.

88
QMF for z/OS offers:
fast, simple connection to a broad spectrum of data sources
IBM DB2
for iSeries
IBM DB2
for LUW
IBM
PureData
Informix
SolidDB IMS
BigInsights
Oracle
SQL
Server
Teradata
MySQL
Postgres
zSQL
Sun JDBC-
ODBC bridge
data sources
such as
Excel and
text files etc.
Cloudant
Hadoop
IBM DB2
for z/OS
Web
Access
–http
data
QMF for
z/OS

89
Full support of the DB2 Analytics Accelerator
10Gb
OSA-Express3
10 GbE
Primary
Backup
zEnterprise
Data Warehouse application
DB2 for z/OS enabled for IBM
DB2 Analytics Accelerator
IBM DB2 Analytics
Accelerator
Netezza
Technology
QMF Users &
QMF BA solutions
Network
DB2 for
z/OS
Note ; All QMF for z/OS
components include explicit
support for DB2 Analytics
Accelerator and prepare
and execute queries that
maximize the chance of
their being offloaded to DB2
Analytics Accelerator, given
that the data is available on
the system.

90
QMF for z/OS and IDAA Customer Scenario
 QMF for z/OS is a DB2 application.
Therefore it works seamlessly with the DB2
Analytics Accelerator
 QMF queries can run over 1000 times faster
with the Accelerator.
 Additionally, QMF can be configured to guide
the optimizer as to which queries can be
selected for acceleration
 Usage case: customers have QMF applications
that mix queries whose data can have a few
minutes of latency with queries where the result
set must reflect the latest transaction results.
 QMF and IDAA have been deployed at
several customers with very good results.
 Banco Do Brasil reports experienced execution
performance improvement from 10 hours to minutes
"It is our plan to replace Microquery in 2014, when all developers are going to use QMF
WebSphere client.“ (Banco Do Brasil)

91
QMF on the Web and enhanced mobile support
 QMF for WebSphere
– Disseminate queries, reports and dashboards to
users across the enterprise for all browsers and
platforms
– Create, run and share queries on the Web
– Run and share reports on the Web
– Deploy dashboards to business users as stand-
alone solutions or embedded within web pages
and web applications
– Deploy to mobile devices (iPad, Android)
 Ability to render content in
– Pure HTML & JavaScript*
– Adobe Flash Player
– PDF
– Excel

92
QMF for z/OS v11.2 Enhancements

In Summary
 Unparalleled investment in DB2 tools and utilities
 IBM Utilities Suite is essential for exploitation of major DB2
enhancements
 Support of core DB2 function from day 1 of GA
 Support & deliver new technology, new interfaces, advanced
autonomics
 Continued focus on:
 Elimination of application impact from utilities
 Elapsed time & CPU consumption reduction
 Resource consumption reduction
 Reduction in complexity & automation improvements
 Solutions through DB2, Utilities & Tools
93

DB2 Real-Time Analytics Meeting Wayne, PA 2015 - IDAA & DB2 Tools Update

DB2 Real-Time Analytics Meeting Wayne, PA 2015 - IDAA & DB2 Tools Update

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (7)

Similaire à DB2 Real-Time Analytics Meeting Wayne, PA 2015 - IDAA & DB2 Tools Update

Similaire à DB2 Real-Time Analytics Meeting Wayne, PA 2015 - IDAA & DB2 Tools Update (20)

Dernier

Dernier (20)

DB2 Real-Time Analytics Meeting Wayne, PA 2015 - IDAA & DB2 Tools Update