Preparing for DB2 near-realtime business intelligence / [Chuck Ballard ...et al.].

Format:

Book

Contributor:

Ballard, Chuck.

International Business Machines Corporation. International Technical Support Organization.

Series:

IBM redbooks.

IBM redbooks

Language:

English

Subjects (All):

Business intelligence--Computer programs.

Business intelligence.

Real-time data processing.

IBM Database 2.

Physical Description:

xviii, 294 p. : ill.

Edition:

1st ed.

Other Title:

Preparing for Database two near-realtime business intelligence

Place of Publication:

Poughkeepsie, NY : IBM, International Technical Support Organization, c2004.

Language Note:

English

System Details:

text file

Summary:

In this IBM Redbooks publication we discuss primary processes and various alternatives that prepare you in implementing a DB2 near-realtime business intelligence environment. We discuss architectural alternatives and include overviews of software products that you can use in an implementation. As a primary focus, we tested the capabilities for supporting continuous update of a DB2 data warehouse while running a continuous concurrent query workload against that data warehouse. We tested several implementation scenarios and the variables that impact them. The results of our testing and the issues we encountered are provided. We used an IBM p-Series multiprocessor, along with a number of software products, including WebSphere MQ, DB2 MQ Listener, DB2 UDB, and DB2 Information Integrator - Replication Edition. We discuss ETL processing in a near-realtime environment, with reference to DB2 Warehouse Manager and DataStage from Ascential Software. We used WebSphere Studio Application Developer to generate online query applications, along with Java, SQL, and C-based stored procedures. We discuss DB2 Query Patroller and DB2 Governor. We provide guidelines and recommended best practices, and this book is what you need to get prepared to implement near-realtime business intelligence in your environment.

Contents:

Front cover

Contents

Notices

Trademarks

Preface

Overview of redbook contents

The team that wrote this redbook

Become a published author

Comments welcome

Chapter 1. Introduction and management summary

Business intelligence for competitive advantage

The need for realtime BI

Highlights and benefits

Chapter 2. Near-realtime business intelligence

2.1 What is near-realtime business intelligence?

2.2 Processes for near-realtime BI

2.3 The role of business activity monitoring (BAM)

2.3.1 Key performance indicators

2.3.2 Business activity management

2.3.3 Getting started with BAM

Chapter 3. Architectural considerations

3.1 Where are we today?

3.2 Data warehousing and the realtime goal

3.3 Technical considerations for realtime BI

3.3.1 Reducing IT costs

3.3.2 Extending the data warehouse

3.4 Going realtime, nearly

3.5 Functions for realtime data warehousing

3.5.1 Capture

3.5.2 Deliver

3.5.3 Transform

3.5.4 Apply

3.6 Putting it together

Chapter 4. Products for near-realtime BI

4.1 Data warehousing - Base for BI

4.1.1 DB2 - the database of choice

4.2 WebSphere MQ for guaranteed data delivery

4.2.1 Queue clustering

4.2.2 DB2 MQ Listener

4.2.3 DB2 MQ functions

4.2.4 WebSphere business integration brokers

4.3 Information integration

4.3.1 DB2 Information Integrator

4.3.2 Data replication

4.3.3 Data federation

4.4 Data transformation

4.4.1 DB2 Warehouse Manager

4.4.2 Ascential Software

4.5 Workload management

4.5.1 DB2 Query Patroller for workload management

4.5.2 DB2 Governor for resource management

Chapter 5. Planning the test environment

5.1 Application scenario definitions

5.2 Transaction definitions

5.3 Data models

5.3.1 ER model

5.3.2 Star model

5.4 Populating the data warehouse.

5.5 Updating the data warehouse

5.5.1 Using stored procedures

5.5.2 The query workload

5.6 Data delivery with WebSphere MQ

5.7 Replication for data transfer

5.8 DB2 Online Load Utility

5.9 Configuration variables

5.9.1 Commit count

5.9.2 Number of DB2 MQ listeners

5.9.3 Lock isolation level

Chapter 6. The project environment

6.1 Software overview

6.2 Environment configuration

6.2.1 AIX server configuration

6.2.2 Client configuration

6.3 Testing continuous update

6.3.1 Test plan assumptions

6.3.2 Testing process

6.4 Test scenarios

6.4.1 Population options

6.4.2 Using queues as data sources

6.4.3 Using DB2 tables as data sources

6.4.4 Test scenarios

6.4.5 Test scripts for queries

Chapter 7. Primary test scenarios

7.1 Scenario 1: DB2 MQ Listener

7.1.1 Test definition

7.1.2 Test-runs

7.1.3 Test-run results

7.2 Scenario 2: SQL stored procedures and DB2 tables

7.2.1 Test definition

7.2.2 Test-runs

7.2.3 Test-run results

7.3 Scenario 3: DB2 view over an MQ queue

7.3.1 Test definition

7.3.2 Test-runs

7.3.3 Test-run results

Chapter 8. Secondary test scenarios

8.1 Scenario 4: DB2 Online Load Utility

8.1.1 Test definition

8.1.2 Test-runs

8.1.3 Test-run results

8.2 Scenario 5: The Merge statement

8.2.1 Test definition

8.2.2 Test-runs

8.2.3 Test-run results

8.3 Scenario 6: Data replication

8.3.1 Test definition

8.3.2 Test-runs

8.3.3 Test-run results

Chapter 9. Conclusions and best practices

9.1 Conclusions

9.1.1 General

9.1.2 Test-based conclusions

9.2 Best practices

9.2.1 Select business areas

9.2.2 Gather requirements

9.2.3 Develop an architecture

9.2.4 Analyze and modify business processes

9.2.5 Develop and implement BAM

9.2.6 Evaluate and select products.

9.2.7 Enable a test realtime implementation

9.2.8 Best of our tests

9.2.9 Evaluate and modify

9.3 Epilog

Appendix A. Ascential Software supports near-realtime BI

A.1 Using the Ascential solution

A.2 The test scenarios

A.3 The test scenario solutions

Appendix B. DB2 and realtime BI

B.1 DB2 framework for BI

B.2 Realtime analytics

Appendix C. Scenario tests: Data models

C.1 ER model

C.2 Star schema

Appendix D. WebSphere MQ and DB2 MQ Listener

D.1 WebSphere MQ on AIX

D.2 AMI installation

D.3 Enable MQ functions for the DB2 database

D.4 Create DB2 view over the MQ queue

D.5 Create new service point using AMI tools

D.6 DB2 MQ Listener installation

D.7 DB2 MQ Listener configuration

Appendix E. Stored procedures and scripts

E.1 DB2 parameters

E.2 General scripts

E.3 Scenario 1: DB2 MQ Listener

E.4 Scenario 2: SQL stored procedures and DB2 tables

E.5 Scenario 3: DB2 View over an MQ queue

E.6 Scenario 4: DB2 online load utility

E.7 Scenario 5: The Merge statement

E.8 Scenario 6: DB2 replication

Appendix F. Supplemental tests

F.1 Test set-up

F.2 Message definition

F.3 Testing process

F.4 Test results

F.5 Conclusions

Abbreviations and acronyms

Glossary

Related publications

IBM Redbooks

Other publications

Online resources

How to get IBM Redbooks

Help from IBM

Index

Back cover.

Notes:

"DB2 information management software"--Cover.

"March 2004."

"SG24-6071-00."

Includes bibliographical references (p. 287-288) and index.

OCLC:

80244005