An Introduction to IMS™ pot

264 Chapter 15 Application Programming for the IMS Database Manager.. 413 Chapter 23 Database Recovery Control Facility.. In This Chapter • IMS and the Apollo Program • IMS as a Database

ptg999

Enterprise Master Data Management

An SOA Approach to Managing Core Information

By Allen Dreibelbis, Eberhard Hechler, Ivan Milman, Martin Oberhofer, Paul Van Run, and Dan Wolfson

ISBN: 0-13-236625-8

The Only Complete Technical Primer for MDM Planners, Architects, and Implementers Enterprise Master Data Management provides

an authoritative, vendor-independent MDM technical reference for practitioners: archi- tects, technical analysts, consultants, solution designers, and senior IT decision makers.

Written by the IBM® data management innovators who are pioneering MDM, this book systematically introduces MDM’s key concepts and technical themes, explains its business case, and illuminates how it inter- relates with and enables SOA.

Drawing on their experience with cutting-edge projects, the authors introduce MDM patterns, blueprints, solutions, and best practices published nowhere else—everything you need to establish a consistent, manageable set of master data, and use it for competitive advantage.

Decision Management Systems

A Practical Guide to Using Business Rules and Predictive Analytics

Empower users to take action instead of simply escalating their problems? Evolve without massive

IT investments?

Decision Management Systems can do all that and more In this book, the field’s leading expert dem- onstrates how to use them to drive unprecedented levels of business value.

Both a practical how-to guide and a framework for planning, Decision Management Systems focuses

on mainstream business challenges.

Related Books of Interest

Sign up for the monthly IBM Press newsletter at ibmpressbooks/newsletters

Visit ibmpressbooks.com for all product information

The Art of Enterprise Information Architecture

A Systems-Based Approach for Unlocking Business Insight

By Mario Godinez, Eberhard Hechler, Klaus Koenig, Steve Lockwood, Martin Oberhofer, and Michael Schroeck

ISBN: 0-13-703571-3

Architecture for the Intelligent Enterprise:

Powerful New Ways to Maximize the Real-time Value of Information Tomorrow’s winning “Intelligent Enterprises”

will bring together far more diverse sources

of data, analyze it in more powerful ways, and deliver immediate insight to decision-makers throughout the organization Today, however, most companies fail to apply the information they already have, while struggling with the complexity and costs of their existing information environments.

In this book, a team of IBM’s leading information management experts guide you

on a journey that will take you from where you are today toward becoming an “Intelligent Enterprise.”

The New Era of Enterprise Business Intelligence:

Using Analytics to Achieve a Global Competitive Advantage

By Mike Biere

ISBN: 0-13-707542-1

A Complete Blueprint for Maximizing the Value of Business Intelligence in the Enterprise

The typical enterprise recognizes the mense potential of business intelligence (BI) and its impact upon many facets within the organization–but it’s not easy to transform BI’s potential into real business value Top BI expert Mike Biere presents a complete blue- print for creating winning BI strategies and infrastructure, and systematically maximiz- ing the value of information throughout the enterprise.

im-This product-independent guide brings together start-to-finish guidance and practical checklists for every senior IT executive, planner, strategist, implementer, and the actual business users themselves.

Related Books of Interest

Listen to the author’s podcast at:

ibmpressbooks.com/podcasts

Related Books of Interest

Sign up for the monthly IBM Press newsletter at ibmpressbooks/newsletters

Data Integration Blueprint and ModelingTechniques for a Scalable and Sustainable Architecture

By Anthony Giordano

ISBN: 0-13-708493-5

Making Data Integration Work: How to Systematically Reduce Cost, Improve Quality, and Enhance Effectiveness Data integration now accounts for a major part of the expense and risk of typical data warehousing and business intelligence projects—and, as businesses increasingly rely on analytics, the need for a blueprint for data integration is increasing now more than ever.

This book presents the solution: a clear, consistent approach to defining, designing, and building data integration components to reduce cost, simplify management, enhance quality, and improve effectiveness Leading IBM data management expert Tony Giordano brings together best practices for architecture, design, and methodology, and shows how

to do the disciplined work of getting data integration right.

Understanding DB2 9 Security

Bond, See, Wong, Chan

ISBN: 0-13-185514-X

Viral Data in SOA

An Enterprise Pandemic Fishman

ISBN: 0-13-700180-0

IBM Cognos 10 Report Studio

Practical Examples Draskovic, Johnson

ISBN-10: 0-13-265675-2

Mining the Talk Unlocking the Business Value in Unstructured Information Spangler, Kreulen

ISBN: 0-13-233953-6

This page intentionally left blank

An Introduction

Second Edition

This page intentionally left blank

An Introduction

Your Complete Guide to IBM®

Information Management System

Second Edition

Barbara Klein, Richard Alan Long, Kenneth Ray

Blackman, Diane Lynne Goff, Stephen P Nathan,

Moira McFadden Lanyi, Margaret M Wilson, John

Butterweck, Sandra L Sherrill

IBM Press

Pearson plc

Upper Saddle River, NJ • Boston • Indianapolis • San Francisco

New York • Toronto • Montreal • London • Munich • Paris • Madrid

Cape Town • Sydney • Tokyo • Singapore • Mexico City

Ibmpressbooks.com

The authors and publisher have taken care in the preparation of this book, but make no expressed

or implied warranty of any kind and assume no responsibility for errors or omissions No

liability is assumed for incidental or consequential damages in connection with or arising out of

the use of the information or programs contained herein

© Copyright 2012 by International Business Machines Corporation All rights reserved

Note to U.S Government Users: Documentation related to restricted right Use, duplication, or

disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM

Corporation

IBM Press Program Managers: Steve Stansel and Ellice Uffer

Cover design: IBM Corporation

Editor in Chief: Bernard Goodwin

Marketing Manager: Stephane Nakib

Publicist: Heather Fox

Managing Editor: Kristy Hart

Designer: Alan Clements

Project Editor: Andy Beaster

Copy Editor: Keith Cline

Indexer: Larry Sweazy

Compositor: Nonie Ratliff

Proofreader: Sarah Kearns

Manufacturing Buyer: Dan Uhrig

Published by Pearson plc

Publishing as IBM Press

IBM Press offers excellent discounts on this book when ordered in quantity for bulk purchases

or special sales, which may include electronic versions and/or custom covers and content

particular to your business, training goals, marketing focus, and branding interests For more

information, please contact:

U S Corporate and Government Sales:

The following terms are trademarks or registered trademarks of International Business Machines

Corporation in the United States, other countries, or both: IBM, the IBM Press logo, IMS, z/OS,

WebSphere, Rational, System z, zSeries, CICS, DB2, Redbooks, RACF, z/VSE, Distributed

Relational Database Architecture, Cognos, VTAM, Parallel Sysplex, Tivoli, NetView,

InfoSphere, OS/390, Guardium, DataStage, and OMEGAMON A current list of IBM

trademarks is available on the web at “Copyright and trademark information” at

www.ibm.com/legal/copytrade.shtml

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both

Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle

and/or its affiliates

UNIX is a registered trademark of The Open Group in the United States and other countries

Windows and Microsoft are trademarks of Microsoft Corporation in the United States, other

countries, or both

Other company, product, or service names may be trademarks or service marks of others

Library of Congress Cataloging-in-Publication Data:

An introduction to IMS : your complete guide to IBM’s Information Management System /

Barbara Klein

[et al.] — [2nd ed.]

p cm

ISBN 978-0-13-288687-1 (pbk : alk paper)

1 Management information systems I Klein, Barbara,

1947-T58.6.I598 2012

658.4’038011—dc23

2011036854All rights reserved This publication is protected by copyright, and permission must be obtained

from the publisher prior to any prohibited reproduction, storage in a retrieval system, or

transmission in any form or by any means, electronic, mechanical, photocopying, recording, or

likewise For information regarding permissions, write to:

Pearson Education, Inc

Rights and Contracts Department

501 Boylston Street, Suite 900

Contents

Part I: Overview of IMS

Chapter 1 IMS: From Apollo to Enterprise .1

IMS and the Apollo Program 1

IMS as a Database Management System 2

IMS as a Transaction Manager 2

Who Uses IMS? 3

IMS and Enterprise Integration 4

Chapter 2 Overview of the IMS Product .5

IMS Database Manager 6

IMS Transaction Manager 8

IMS System Services 9

IMS Product Documentation 9

Hardware and Software Requirements for IMS 10

Hardware 10

Software 10

Chapter 3 Access to and from IMS .13

IMS-Managed Application Program Access 13

Accessing IMS by Using DL/I Calls 14

Accessing IMS TM 14

IMS Connect 16

Accessing IMS DB Using JDBC 16

Accessing IMS from Other Application Runtime Environments 19

Accessing IMS DB 19

Accessing IMS TM 20

Access to and from IMS Using the IMS SOA Integration Suite Components 20

IMS Enterprise Suite Connect APIs 22

IMS Enterprise Suite SOAP Gateway 22

IMS TM Resource Adapter 24

IMS MFS Web Enablement 25

MFS SOA Support 27

IMS Solutions for Java Development 27

IMS Enterprise Suite DLIModel Utility Plug-In 27

IMS Enterprise Suite Explorer for Development 27

IMS XML DB 29

IMS Web 2.0 Solutions for IMS DB and IMS TM 29

Accessing from IMS 30

Accessing to and from IMS 32

Chapter 4 IMS and z/OS .33

How IMS Relates to z/OS 33

Structure of IMS Subsystems 33

IMS Control Region 34

IMS Environments 34

IMS Separate Address Spaces 41

Internal Resource Lock Manager 48

IMS Connect 48

Advanced Program-to-Program Communications 48

Running an IMS System 49

Running Multiple IMS Systems 49

Running Multiple IMS Systems on a Single z/OS Image 49

Running Multiple IMS Systems on Multiple z/OS Images 50

How IMS Uses z/OS Services 50

Resource Access Control Facility 51

Resource Recovery Services 51

Parallel Sysplex 52

Cross-System Coupling Facility 52

Cross-System Extended Services 53

Automatic Restart Management 53

Chapter 5 Setting Up, Running, and Maintaining IMS .55

Installing IMS 55

Installing IMS Using SMP/E 56

IMS Installation Verification Program 56

Defining an IMS System 57

IMS Startup 57

Types of IMS System Starts 57

Starting Regions That Are Related to IMS 58

IMS Logging 60

IMS Utility Programs 60

IMS Recovery 60

Extended Recovery Facility 60

Remote Site Recovery 61

Database Recovery Control Facility 61

Fast Database Recovery 61

IMS Database Recovery Facility for z/OS 61

IMS Shutdown 61

Maintaining an IMS System 62

Part II: IMS Database Manager Chapter 6 Overview of the IMS Database Manager .63

IMS Database Manager Overview 63

Implementation of IMS Databases 64

Overview of Full-Function Databases 64

Overview of Fast Path DEDBs 64

Full-Function Databases 65

Fast Path Data Entry Databases 66

Storing Data in IMS and DB2 for z/OS 66

Storing XML Data in IMS 67

Open Database Manager 67

Workload Routing and Distribution 71

Chapter 7 Overview of the IMS Hierarchical Database Model .75

IMS Hierarchical Database Basics 76

Basic Segment Types 79

Sequence Fields and Access Paths 80

Logical Relationships 81

Secondary Indexes 81

Logical Relationships 81

Secondary Index Databases 85

Chapter 8 Implementing the IMS Hierarchical Database Model .89

Segments, Records, and Pointers 90

Physical Segment Design 91

IMS Hierarchical Access Methods 93

HDAM Access Method 95

HIDAM Access Method 100

PHDAM and PHIDAM Access Methods 103

Index Databases 106

Fast Path DEDBs 106

GSAM Access Method 112

HSAM and HISAM Access Methods 112

Operating System Access Methods 113

Data Set Groups 114

Choosing Between VSAM and OSAM for Data Set Groups 115

IMS Checkpoints 116

Application Program Checkpoints 116

Locking Data 118

DB2 and Deadlocks 119

Methods of Sharing Data 120

Chapter 9 Data Sharing .123

How Applications Share Data 124

DBRC and Data Sharing 125

Chapter 10 The Database Reorganization Process .127

Purpose of Database Reorganization 128

When to Reorganize Databases 128

Reactive Reorganizing 128

Proactive Reorganization 129

Monitoring the Database 130

Sample Reorganization Guidelines 130

Overview of the Database Reorganization Process 132

Reorganizing HALDBs 132

Offline Reorganization 132

Online Reorganization 146

Chapter 11 The Database Recovery Process .153

Determining When Recovery Is Needed 153

Overview of the Database Recovery Process 154

Online Programs and Recovery 155

DB Batch Update Programs and Recovery 155

IMS Backup and Recovery Utilities 155

Database Image Copy Utility 156

Database Image Copy 2 Utility 158

Online Database Image Copy Utility 159

Database Change Accumulation Utility 159

Database Recovery Utility 161

Batch Backout Utility 164

Part III: IMS Transaction Manager

Chapter 12 Overview of the IMS Transaction Manager .167

IMS TM Control Region 169

Data Communications Control Environment 169

IMS TM Network Overview 170

Required IMS TM Network Components 173

Optional IMS TM Network Components 173

Terminal Types 174

Static 174

Dynamic 174

Extended Terminal Option 174

APPC/IMS 175

APPC/IMS Application Programming Interfaces 175

MSC and ISC 176

Multiple Systems Coupling 176

Intersystem Communication 177

Comparing the Functions of MSC and ISC 178

Input Message Types 179

Input Destination 179

Message Format Service 180

Message Queuing 180

Message Queue Size and Performance Considerations 182

Multiple Message Queue Data Sets 182

Fast Path Transactions and Message Queues 183

Shared Queues 183

Operating an IMS Network 188

Master Terminal 189

Initiating a Session with IMS 192

Open Transaction Manager Access 193

OTMA Asynchronous Output 194

OTMA Security 196

OTMA Callable Interface 197

IMS Connect 198

IMS Connect OTMA Interface 199

IMS TM Resource Adapter 204

IMS Connect APIs 205

Workload Routing with the IMS Connect OTMA Interface 205

Workload Balancing with the Sysplex Distributor 205

Ports 207

Connection Types and Considerations 207

IMS Connect Load Balancing and Routing 208

Asynchronous Output and Supermember Support 210

IMS Connect Operations Manager Interface 213

IMS-to-IMS Connections over TCP/IP 213

WebSphere MQ 214

Using the WebSphere MQ API in IMS Dependent Regions 214

IMS BMP Trigger Monitor 216

WebSphere MQ IMS Bridge 216

Chapter 13 How IMS TM Processes Input .223

IMS TM Messages 223

IMS Message Format 225

Input Message Origin 226

Transaction Scheduling 226

Message Region Scheduling 226

Scheduling Conditions 228

Program and Transaction Definitions That Affect Scheduling 229

Definition Parameters That Affect Transaction Scheduling 230

Defining the Class of a Transaction 230

Defining the Priority of a Transaction 231

Processing Limit Count and Time 232

Parallel Scheduling 232

Database Processing Intent 233

Scheduling a BMP or JBP Application 233

Scheduling Fast Path Transactions 234

Fast Path-Exclusive and Fast Path-Potential Transactions 234

Scheduling in a Shared-Queues Environment 235

IMS Transaction Flow 235

OTMA Message Processing 236

Commit Mode 0 (CM0): Commit-Then-Send 236

Commit Mode 1 (CM1): Send-Then-Commit 236

Synclevel 0 (SL0): None 236

Synclevel 1 (SL1): Confirm 238

Synclevel 2 (SL2): Syncpoint 238

Synchronous Callout 239

IMS Connect Implementation of Synchronous Callout 240

Transaction Expiration 242

Part IV: IMS Application Development Chapter 14 Application Programming Overview .243

Application Program Structure 244

An ENTRY Statement 245

A PCB or AIB 246

Some DL/I Calls 246

A Status Code Processing Section 246

A Termination Statement 246

Entry to the Application Program 246

PCB Mask 247

AIB Mask 252

Calls to IMS 254

Status Code Processing 255

Application End of Processing 256

IMS Setup for Applications 257

IMS Control Blocks 257

IMS System Definition 259

IMS Application Programming Interfaces 261

IMS Application Calls 261

Get Unique (GU) 261

Get Next (GN) 261

Get Hold Unique (GHU) and Get Hold Next (GHN) 261

Insert (ISRT) 262

Delete (DLET) 262

Replace (REPL) 262

ICAL Call 262

IMS System Service Calls 262

Testing IMS Applications 264

Chapter 15 Application Programming for the IMS Database Manager .267

Introduction to Database Processing 267

Application Programming Interfaces to IMS 268

Processing a Single Database Record 273

IMS Database Positioning 274

Retrieving Segments 275

Updating Segments 279

Calls with Command Codes 283

Database Positioning After DL/I Calls 286

Using Multiple PCBs for One Database 287

Processing GSAM Databases 287

COBOL and PL/I Programming Considerations 289

COBOL Programming Considerations 289

PL/I Programming Considerations 291

Processing Databases with Logical Relationships 293

Accessing a Logical Child in a Physical Database 293

Accessing Segments in a Logical Database 293

Processing Databases with Secondary Indexes 294

Accessing Segments by Using a Secondary Index 295

Creating Secondary Indexes 297

Loading Databases 297

Overview of Loading Databases 297

Loading a Database That Has Logical Relationships 298

Loading a Database That Has Secondary Indexes 300

Using Batch Checkpoint/Restart 300

Using the Restart Call 303

Using the Checkpoint Call 305

Chapter 16 Application Programming for the IMS Transaction Manager .309

Application Program Processing 309

Role of the PSB 311

DL/I Message Calls 312

Message Segments 312

Conversational Processing 312

Output Message Processing 312

Message Switching 313

Callout Requests for External Services or Data 313

Application Program Termination 313

Logging and Checkpoint/Restart Processing 314

Program Isolation and Dynamic Logging 314

Transaction Manager Application Design 314

Online Transaction Processing Concepts 315

Online Program Design 317

Basic Screen Design 318

General IMS TM Application Design Guidelines 320

Chapter 17 Editing and Formatting Messages .321

Message Format Service 321

MFS Components 323

Administering MFS 327

MFS Control Blocks 329

Advantages of Using MFS 331

Basic Edit Function 332

Chapter 18 Application Programming in Java .335

IMS Universal Drivers Overview 336

IMS Database Java Metadata 337

Supported SQL Keywords 340

Variable-Length Segment Support 340

Virtual Foreign Key Fields 341

IMS Support for the JVM Runtime Environment 341

Developing JMP Applications 341

JMP Applications and Conversational Transactions 344

Developing JBP Applications 344

Issuing Synchronous Callout Requests from a Java Dependent Region 346

Enterprise COBOL Interoperability with JMP and JBP Applications 346

Accessing DB2 for z/OS Databases from JMP or JBP Applications 347

Java Interoperability with MPP, IFP, and BMP Applications 348

Distributed Connectivity with the IMS Universal Drivers 348

WebSphere Application Server for z/OS Applications 349

DB2 for z/OS Stored Procedures 349

CICS Applications 349

XML Storage in IMS Databases 351

Decomposed Storage Mode for XML 351

Intact Storage Mode for XML 352

Using IMS Explorer for Development for Testing 357

Part V: IMS System Administration Chapter 19 The IMS System Definition Process .359

Overview of the IMS System Definition Process 360

Types of IMS System Definitions 362

Stage 1 of the IMS System Definition Process 363

Stage 2 of the IMS System Definition Process 363

JCLIN Processing 364

SMP/E Maintenance 364

IMS Security 364

IMS System Definition Macros 364

Extended Terminal Option 369

ETO Terminology 370

How Structures Are Created and Used 373

Descriptors and Exit Routines 374

How Descriptors Are Created and Used 374

Summary of ETO Implementation 375

Dynamic Resource Definition and Online Change 377

Dynamic Resource Definition 377

The Online Change Process 380

Chapter 20 Customizing IMS .383

What Can Be Customized 384

Exit Routine Naming Conventions 385

Changeable Interfaces and Control Blocks 385

IMS Standard User Exit Parameter List 385

Routine Binding Restrictions 386

Registers and Save Areas 386

IMS Callable Services 386

Storage Services 386

Control Block Services 387

Automated Operator Interface Services 387

Using Callable Services 387

Exit Routine Performance Considerations 387

Summary of IMS Exit Routines 388

Chapter 21 IMS Security .397

Overview of DB/DC and DCCTL Security 397

DB/DC and DCCTL Resources That Can Be Protected 398

Defining Security During DB/DC and DCCTL System Definition 398

Security Facilities for DB/DC and DCCTL Resources 399

Overview of DBCTL Security 401

DBCTL Resources That Can Be Protected 401

Defining Security During DBCTL System Definition 402

Security Facilities for DBCTL Resources 402

Chapter 22 IMS Logging .405

Overview of IMS System Logging 405

Database Recovery Control Facility 407

IMS System Checkpoints 407

IMS Log Data Sets 408

Online Log Data Sets 408

Write-Ahead Data Sets 412

System Log Data Sets 412

Recovery Log Data Sets 413

IMS Restart Data Set 413

IMS Log Buffers 413

Chapter 23 Database Recovery Control Facility .415

Overview of DBRC 416

DBRC Tasks 416

DBRC Components 417

RECON Data Set 417

Database Recovery Control Utility (DSPURX00) 417

Skeletal JCL 418

When to Use DBRC 418

Communicating with DBRC 419

DBRC Commands 419

DBRC API 420

DBRC Functions 420

Recording and Controlling Log Information 421

How DBRC Helps in Recovery 424

Recording Information about Opening and Updating Databases 429

Supporting Data Sharing 430

Supporting Remote Site Recovery 432

Supporting IMSplexes 433

Overview of the RECON Data Sets 433

RECON Records 434

Database-Related Information 436

IMS Systems and the RECON Data Set 436

Database Names in the RECON Data Set 436

Defining and Creating the RECON Data Sets 437

Placement of the RECON Data Sets 438

Initializing the RECON Data Sets 438

Allocating the RECON Data Sets to an IMS System 438

Maintaining the RECON Data Sets 439

Backing Up the RECON Data Sets 440

Deleting Inactive Log Records from the RECON Data Sets 440

Monitoring the RECON Data Sets 440

Reorganizing RECON Data Sets 441

Re-Creating the RECON Data Sets 442

Recommendations for RECON Data Sets 443

Chapter 24 Operating IMS .445

Controlling IMS 445

Controlling IMS with the TSO SPOC Application 445

Issuing Batch SPOC Commands 447

Modifying and Controlling System Resources 448

Modifying System Resources Online 448

List of Commands with Similar Functions for Multiple Resources 453

Modifying Dependent Regions 461

Modifying Telecommunication Lines 461

How to Modify Terminals 461

Modifying and Controlling Transactions 462

Database Control 462

Creating, Updating, Deleting, and Querying Resource Definitions Dynamically 463

Modifying ETO User IDs and Assignments of ISC Users 464

Modifying Multiple System Coupling Resources 464

Modifying Security Options 464

Displaying and Terminating Conversations 465

Modifying and Controlling Subsystems 465

Controlling OTMA Input Messages 465

Recovery During the IMSRSC Repository Data Set Update Process 465

Connecting and Disconnecting Subsystems 465

Starting IMS 466

Starting an IMSplex 467

Starting the CSL 467

Starting the IMS Control Region 467

Starting the IRLM 468

Starting the CQS 468

Starting Dependent Regions 468

Starting the IMS Transaction Manager 469

Starting IMS Connect 469

Restarting IMS 469

Cold Start 470

Warm Start 470

Emergency Restart 470

Monitoring the System 470

Monitoring IMS Connect Connections 471

IMS System Log Utilities 472

Gathering Performance-Related Data 473

IBM IMS Tools 474

Shutting Down IMS 474

Stopping the IMS Transaction Manager 475

Stopping Dependent Regions 475

Shutting Down the IMS Control Region 475

Stopping the IRLM 476

Shutting Down CQS 476

Shutting Down an IMSplex 476

IMS Failure Recovery 477

Executing Recovery-Related Functions 478

Issuing DBRC Commands 478

Dumping the Message Queues 479

Recovering the Message Queues 479

Archiving the OLDS 480

Making Databases Recoverable or Nonrecoverable 480

Running Recovery-Related Utilities 480

Controlling Data Sharing 480

Controlling Data Sharing Using DBRC 481

Monitoring the Data-Sharing System 481

Chapter 25 IMS Recovery Facilities .483

Recovery of Failing IMS Components 484

Recovery Using Dynamic Backout and Batch Backout 485

Recovery of Repository Server in an IMSplex 486

Recovery in a Parallel Sysplex Environment 487

Recovery Using InfoSphere IMS Replication for z/OS 487

Recovery Using IMS Recovery Expert for z/OS 488

Recovery Using the Extended Recovery Facility 489

Recovery Using Remote Site Recovery (RSR) 490

Chapter 26 IBM IMS Tools .493

Application Management Tools 493

IBM IMS Batch Backout Manager for z/OS 494

IBM IMS Batch Terminal Simulator for z/OS 494

IBM IMS Program Restart Facility for OS/390 495

Backup and Recovery Tools 495

IBM IMS DEDB Fast Recovery for z/OS 495

IBM IMS Recovery Expert for z/OS 495

IBM IMS Recovery Solution Pack for z/OS 496

Database Administration and Change Management Tools 497

IBM IMS High Availability Large Database Toolkit for z/OS 497

IBM IMS Sequential Randomizer Generator for OS/390 497

IBM Tools Base for z/OS 497

Data Governance/Regulatory Compliance Tools 498

IBM IMS Audit Management Expert for z/OS 498

Information Integration Management Tools 499

IBM IMS DataPropagator for z/OS 499

IBM InfoSphere Classic Data Event Publisher for z/OS 500

IBM InfoSphere Classic Replication Server for z/OS 500

Performance Management Tools 501

IBM IMS Buffer Pool Analyzer for z/OS 501

IBM IMS Network Compression Facility for z/OS 501

IBM IMS Performance Solution Pack for z/OS 502

IBM Tivoli OMEGAMON XE for IMS on z/OS 502

IBM Transaction Analysis Workbench for z/OS 503

Transaction Management and System Management Tools 503

IBM IMS Command Control Facility for z/OS 503

IBM IMS Configuration Manager for z/OS 503

IBM IMS Extended Terminal Option Support for z/OS 504

IBM IMS High Performance System Generation Tools for z/OS 504

IBM IMS Queue Control Facility for z/OS 505

IBM IMS Sysplex Manager for z/OS 505

IBM IMS Workload Router for z/OS 505

Utilities Management Tools 506

IBM IMS Cloning Tool for z/OS 506

IBM IMS Database Control Suite for z/OS 506

IBM IMS Database Reorganization Expert for z/OS 507

IBM IMS Database Solution Pack z/OS 507

IBM IMS Fast Path Solution Pack for z/OS 508

IBM IMS Online Reorganization Facility for z/OS 509

Miscellaneous IMS Tools 510

Part VI: IMS in a Parallel Sysplex Environment

Chapter 27 Introduction to Parallel Sysplex .511

Goals of a Sysplex Environment 512

Some Components and Terminology in a Parallel Sysplex 513

IMS Data Sharing and the Sysplex Environment 514

DBRC and Data-Sharing Support 515

Block-Level Data Sharing 515

Fast Database Recovery 516

Sysplex Data-Sharing Concepts 517

Summary of IMS Data Sharing and the Sysplex Environment 518

IMS Transaction Manager and the Sysplex Environment 520

IMS Shared Queues 520

VTAM Generic Resource Support 523

Other Workload-Routing and Workload-Balancing Capabilities 523

Summary of IMS TM and the Sysplex Environment 524

IMS Common Service Layer and the IMSplex 525

IMSplex Overview 528

IMS Components and System Services That Are Part of an IMSplex 530

Common Queue Server 530

Common Service Layer 530

Repository Server (RS) 531

Multiple Systems Coupling in an IMSplex 531

Recovering Systems in an IMSplex 531

z/OS Components and System Services Used in an IMSplex 532

Common Service Layer Overview 532

CSL Configuration Examples 533

CSL Managers 540

Overview of the CSL Open Database Manager 540

Overview of the CSL Operations Manager 540

Overview of the CSL Resource Manager 542

Overview of the CSL Structured Call Interface 543

Defining and Tailoring an IMSplex 543

Defining a Simplified IMSplex for the Type-2 Command Environment 545

IMS Functions That Use the IMS Common Service Layer 545

Operating an IMSplex 546

A Single SPOC Program in CSL to Control an IMSplex 547

The TSO SPOC 550

The Batch SPOC 551

Sequence for Starting CSL Address Spaces 552

Part VII: Appendixes

Appendix A Glossary .553

Appendix B Notices .567

Index .571

Acknowledgments

This book would not be possible without the input and efforts of many people, some of whom are

listed here Our wholehearted thanks go to all who participated in and supported this project,

par-ticularly to the following people:

• Dean Meltz, Rick Long, Mark Harrington, Robert Hain, and Geoff Nicholls for the

information in the IMS Primer and the first edition of this book, which was the

founda-tion for this second edifounda-tion

• Susan Visser, Steve Stansel, and Terry Carroll of IBM, and Bernard Goodman, Michelle

Housley, and Andy Beaster of Pearson Education, for their guidance and patient

assis-tance in the creation of this book

• Clark Gussin, Visual Designer at IBM, for his assistance with the illustrations in this

book

• Don Streicher, Dean Meltz, Suzie Wendler, Kevin Hite, and other members of the IBM

IMS organizations for their input to the development of this edition of the book

About the Authors

• Barbara Klein, responsible for the strategy and introduction of new IMS capabilities,

has held various positions in IBM Planning, Design, Development, Assurance, Systems

Engineering, Marketing, and Management

• Richard Alan Long, IMS Development Level 2 Database Support Team member since

2002, began with IMS in the late 1970s working in various programming and database

administration roles

• Kenneth Ray Blackman, IBM Certified IT Specialist - IMS Advanced Technical

Skills, consults on IMS connectivity, IMS application modernization and System z

inte-gration architectures, and presents IMS topics at technical conferences and seminars

• Diane Lynne Goff, IBM IMS Advanced Technical Skills Senior I/T Specialist, has

pre-sented IMS topics at technical conferences and seminars, worked with IMS customers,

and provided System z hardware and software support

• Stephen P Nathan has 38 years of experience as an IMS developer, application analyst,

DBA, systems programmer, and performance tuner He has worked for IBM in IMS

Level 2 Support since 2003

• Moira McFadden Lanyi has been the Technical Editor, Terminologist, and

Informa-tion Architect for the IMS InformaInforma-tion Development team since 2003, and has also

worked as a Visual Designer and Project Manager at IBM

• Margaret M Wilson, now retired from IBM, spent more than 20 years of her IBM

career working with IMS and IMS Tools, testing IMS software, teaching IMS basics,

and marketing IMS Tools

• John Butterweck, IBM Worldwide IMS Technical Support Team member, specializes

in assisting customers with IMS installation and maintenance

• Sandra L Sherrill, IMS Worldwide Market Manager, has spent more than 20 years

working on IMS teams

Preface

IBM®Information Management System (IMS™) is one of the world’s premier software products

Period IMS is not mentioned in the news and, until fairly recently, was barely mentioned in

com-puter science classes But IMS has been and, for the foreseeable future, will continue to be a

cru-cial component of the world’s software infrastructure

Since its origin with the National Aeronautic and Space Administration (NASA) Apollo

program, IMS has provided the foundation that enables government agencies and businesses to

access, manipulate, and exploit their vast stores of data As the information age evolves, so does

IMS

The purpose of this book is twofold:

• To introduce IMS and provide basic education about this cornerstone product

• To reintroduce IMS to the computer science field in general

Prerequisite Knowledge

Before reading this book, you should be able to describe the fundamentals of data processing,

including the function of operating systems, access methods, and job control language (JCL)

Specifically, you should be familiar with the z/OS®operating system or any of its predecessors

The authors of this book assume that most readers are data processing professionals You can

learn more by visiting the z/OS Basic Skills Information Center at http://publib.boulder.ibm.com/

infocenter/zos/basics/index.jsp

Learning More About IMS

This book introduces the fundamentals of IMS To learn more, including about how to use the

product capabilities described in this book, read the IMS product publications, which are

avail-able in PDF book and HTML format on the web Publications for all supported versions of IMS

are available in the IMS Information Center at http://publib.boulder.ibm.com/infocenter/imzic

We Welcome Your Feedback

Your feedback helps us provide the most accurate and highest quality information If you have

comments about this book or any other IMS product information, you can send us feedback by

either of the following methods:

• Clicking the Feedback link in the footer of any IMS Information Center topic

• Sending an email to imspubs@us.ibm.com

1

IMS is IBM’s premier transaction and pre-relational database management system, virtually

unsurpassed in database and transaction processing availability and speed IMS clients have

trusted IMS with their most critical business asset—their operational data—for decades

Today’s IMS has only a superficial resemblance to the product that first shipped in 1969

However, an application program that ran on IMS in 1969 will still run today, unchanged, on

the current release of IMS From the beginning, IBM’s focus on the future of IMS has been

unwavering

IMS continues to be a strategic component of today’s enterprise computing environments

This chapter highlights some of the history of IMS and describes how IMS fits into contemporary

IT multitiered enterprise architectures

In This Chapter

• IMS and the Apollo Program

• IMS as a Database Management System

• IMS as a Transaction Manager

• Who Uses IMS?

• IMS and Enterprise Integration

IMS and the Apollo Program

On May 25, 1961, United States President John F Kennedy challenged American industry to

send an American man to the moon and return him safely to earth, thus launching the Apollo

program North American Aviation, in partnership with IBM, fulfilled the requirement for an

C H A P T E R 1

IMS: From Apollo to

Enterprise

automated system to manage large bills of material for the construction of the spacecraft in 1965

In 1966, the IBM and North American Aviation teams were joined by three members from

Cater-pillar Tractor Together, they designed and developed a system that was called Information

Con-trol System and Data Language/Interface (ICS/DL/I)

The IBM team completed and shipped the first release of ICS in Los Angeles in 1967,

and in April 1968, ICS was installed The first “READY” message was displayed on an IBM

2740 typewriter terminal at the Rockwell Space Division at NASA in Downey, California, on

August 14, 1968 Less than a year later, on July 20, 1969, Apollo 11 landed on the moon’s

sur-face ICS was subsequently relaunched as Information Management System/360 (IMS/360)

and made available to the IT world In short order, IMS helped NASA fulfill President

Kennedy’s dream and also became the foundation for the database management system

(DBMS) business

Much has changed since 1968; IMS continues to evolve to meet and exceed the data

pro-cessing requirements demanded by today’s enterprise businesses and governments

IMS as a Database Management System

The IMS DBMS introduced the idea that application code should be separate from data The

point of separation was the Data Language/Interface (DL/I) IMS controls the access and

recov-ery of the data Application programs can still access and navigate through the data by using the

DL/I standard callable interface

This separation established a new paradigm for application programming The application

code could now focus on the manipulation of data, without the complications and overhead

asso-ciated with the access and recovery of data This paradigm nearly eliminated the need for

redun-dant copies of the data Multiple applications could access and update a single instance of data,

thus providing current data for each application Online access to data also became easier

because the application code was separated from the data control

IMS as a Transaction Manager

IBM developed an online component to ICS/DL/I to support data communication access to the

databases The DL/I callable interface was expanded to the online component of the product to

enable data communication transparency to the application programs A message queue function

was developed to maintain the integrity of data communication messages and to provide for

scheduling of the application programs

The online component to ICS/DL/I became the Data Communications (DC) function of

IMS, which is known today as the IMS Transaction Manager (IMS TM)

Who Uses IMS?

Over 90% of the top worldwide companies in the following industries use IMS to run their daily

IMS remains a viable, even unmatched, platform to implement very large online transaction

pro-cessing (OLTP) systems and, in combination with web application server technology, is the

foun-dation for a new generation of web-based, high-workload applications

The following quote describes how one analyst1views IMS:

IMS is not “old technology,” but it is time-tested technology Its platform, the

main-frame, is far from obsolete and in many ways is out in front regarding virtualization and

consolidation capabilities that new technologies are still catching up to For the vast

majority of IMS users, the emphasis should be on “How can I expand my use of IMS to

take maximum advantage of its potential?”

Here are some interesting facts about how IMS is used

• IMS manages a large percentage of the world’s corporate data.

• Over 90% of top Fortune 1000 companies use IMS

• IMS manages over 15 million gigabytes of production data

• More than $3 trillion per day is transferred through IMS by one customer

1Quote taken from IDC white paper, A Platform for Enterprise Data Services: The Proven Power and Flexibility of

IMS from IBM.

• IMS processes over 50 billion transactions per day.

• IMS serves more than 200 million users every day

• IMS processes over 180 million transactions per day on a single IMS system

via IMS Connect for one customer

• IMS manages over 375 million accounts for one customer

IMS and Enterprise Integration

Today’s IT architecture requires end-to-end integration across the enterprise and with key

part-ners, suppliers, and customers Such an architecture enables enterprises to respond with

flexibil-ity and speed to any customer demand, any market opportunflexibil-ity, and any external threat This level

of IT complexity must be addressed by an infrastructure that meets the following requirements:

• Based on open standards IMS fully supports Java standards for application

develop-ment and XML for transparent docudevelop-ment interchange

• Heterogeneous IMS applications can be developed on workstations and run in the host

environment IMS applications and data can be accessed from any platform, including

Linux®, almost anywhere on the Internet, through the IMS Connect function, the IMS

TM Resource Adapter, and the IMS Universal drivers IMS Enterprise Suite SOAP

Gateway enables IMS applications to provide and request web services independent of

platform, environment, application language, or programming model

• Integrated Integration has always been an IMS priority IMS ships connectors and

tooling with IBM WebSphere®solutions so that customers can connect to IMS

applica-tions and data by using the tools and connectors of their choice IMS delivers

Eclipse-based plug-ins for use with Rational®Developer for System z®that simplify common

application development tasks

• Scalable IMS continues to address scalability needs by providing the highest possible

availability, performance, and capacity

• Enabled with self-managing capabilities IMS addresses the need to assist technical

support staff in being more productive, keeping systems continuously available in an

operating environment that is growing increasingly complex

• Reliable One large IMS customer has operated for more than 10 years (and counting)

without an outage in a 24x7 environment Most IMS customers will say that they cannot

recollect when their last unplanned outage occurred

The ongoing focus that IMS has in support of an open, integrated, simplified, on-demand

operat-ing environment, and the success of those who capitalize on their IMS investment, suggests that

IMS will remain a major factor in enterprise architectures worldwide and continue to be a great fit

for the future of IT

5

IMS consists of three components:

• IMS Database Manager (IMS DB)

• IMS Transaction Manager (IMS TM)

• A set of system services that provide common services to IMS DB and IMS TM

Often referred to collectively as IMS DB/DC (DC stems from the original name for the IMS

Transaction Manager: Data Communications), these components comprise a complete online

transaction and database processing environment that provides continuous availability and data

integrity IMS delivers accurate, consistent, timely, and critical information to application

pro-grams, which in turn deliver the information to many end users and programs

IMS has been developed to provide an environment for applications that require very high

levels of performance, throughput, and availability IMS runs on z/OS and on zSeries®hardware,

and uses many of the facilities offered by the operating system and hardware

IMS TM and IMS DB can be ordered separately if both components are not required The

appropriate system services are provided for the components that are ordered When IMS DB is

ordered by itself, it is called DB Control (DBCTL) When IMS TM is ordered by itself, it is called

DC Control (DCCTL)

Because each new release of IMS is upwardly compatible, applications that were written

for an earlier release of IMS run without modification (in most cases) with a new release This is

one way IMS protects the investment that customers have made in their applications

To accommodate the changing requirements of IT systems, many new features have been

added to IMS over the years IMS is also always among the first to support new computing

para-digms such as service-oriented architecture (SOA) and Web 2.0

C H A P T E R 2

Overview of the IMS

Product

Application programs that use IMS functions can be written in a number of programming

languages These applications access IMS resources by calling a number of IMS functions

through standard application programming interfaces (APIs):

• Data Language/Interface (DL/I)

• Java™Database Connectivity (JDBC)

• Java Message Service (JMS)

In This Chapter

• IMS Database Manager

• IMS Transaction Manager

• IMS System Services

• IMS Product Documentation

• Hardware and Software Requirements for IMS

IMS Database Manager

IMS DB is a database management system (DBMS) that helps you organize business data with

both program and device independence

Hierarchical databases and data manipulation language (DL/I calls) are the heart of IMS

DB Data within the database is arranged in a tree structure, with data at each level of the

hierar-chy related to, and in some way dependent on, data at a higher level of the hierarhierar-chy Figure 2-1

shows the hierarchical database model In a hierarchical database, data is stored in the database

only once, but it might be able to be retrieved by several paths IMS logical relationships and

sec-ondary indexes are discussed in Part II, “IMS Database Manager.”

With IMS DB, you can do the following:

• Maintain data integrity The data in each database is consistent and remains in the

data-base even when IMS DB is not running

• Define the database structure and the relationships between the database segments IMS

segments in one database can have relationships with segments in a different IMS

data-base (logical relationships) IMS datadata-bases also can be accessed by one or more

PARTLevel 1 Parent of Stockand Purchase Order

Child of Part and Parent

of Detail

Child of Purchase Order

Level 2

Level 3

PURCHASEORDER

DETAILSTOCK

Figure 2-1 Hierarchical Database Model

• Perform database transactions (inserts, updates, and deletes) as a single unit of work so

that the entire transaction either completes or does not complete

• Perform multiple database transactions concurrently, with the results of each transaction

kept isolated from the others

• Maintain the databases IMS DB provides facilities for backing up and recovering IMS

databases, as well as facilities for tuning the databases by reorganizing and

restructur-ing them

In addition, IMS DB enables you to adapt IMS databases to the requirements of varied

applica-tions Application programs can access common (and therefore consistent) data, thereby reducing

the need to maintain the same data in multiple ways in separate files for different applications

IMS databases are accessed internally using a number of IMS database organization access

methods The database data is stored on disk storage using z/OS access methods IMS DB

pro-vides access to these databases from applications running under the following:

• IMS Transaction Manager (IMS TM)

• CICS®Transaction Server for z/OS

• z/OS batch jobs

• WebSphere Application Server for z/OS

• DB2®for z/OS stored procedures

In addition, IMS Version 11 and later includes the IMS Open Database Manager (ODBM)

ODBM enables access to IMS databases from Java programs anywhere in the enterprise using

Distributed Relational Database Architecture™(DRDA) and distributed database management

(DDM)

IMS Transaction Manager

IMS TM is a message-based transaction processor

DEFINITIONS

spe-cific business application program (a process or job) The message that

trig-gers the application program, and the return of any results, is considered one

transaction.

con-trollers The operator terminals can be keyboard printers, display stations with

keyboards, communication terminals, or a combination of these devices.

IMS TM provides services to do the following:

• Process input messages received from a variety of sources, such as the terminal network,

other IMS systems, WebSphere MQ, and the web

• Process output messages that are created by application programs

• Provide an underlying queueing mechanism for handling these messages

• Provide interfaces to the TCP/IP network (IMS Connect)

• Provide high-volume, high-performance, high-capacity, low-cost transaction processing

for both IMS DB hierarchical databases and DB2 relational databases

IMS TM supports many terminal sessions, on a wide variety of terminals and devices, at extremely

high transaction volumes The users of the terminal sessions can be any of the following:

• People at terminals or workstations

• Other application programs on the same z/OS system, on other z/OS systems, or on

non-z/OS platforms

When IMS TM is used with a database manager, IMS TM extends the facilities of the database

manager to the online, real-time environment IMS TM enables terminals, other devices, and

other subsystems to enter transactions that initiate application programs that can access IMS DB

and DB2 databases and return results

You can define a variety of online processing options For example, you can define

transac-tions for high-volume data-entry applicatransac-tions, others for interactive applicatransac-tions, and still others

to support predefined queries

For more information about IMS TM, see Chapter 12, “Overview of the IMS Transaction

Manager,” and Chapter 13, “How IMS TM Processes Input,” in Part III, “IMS Transaction

Manager.”

IMS System Services

IMS System Services provide the following services to both IMS DB and IMS TM:

• Data integrity

• Restart and recovery of IMS after normal shutdown and failures

• Security, by controlling access to and modification of IMS resources

• Application program management by dispatching work, loading application programs,

and providing locking services

• Diagnostic and performance information

• Facilities for operating IMS

• Interfaces to other z/OS subsystems that communicate with IMS applications

The IMS System Services are accessed by doing the following:

• Issuing IMS commands

• Running IMS-supplied utility programs

• Running IMS-supplied or user-written exit routines

• Defining the services that you want as part of the system definition process

IMS Product Documentation

The primary resource for IMS product documentation is the IMS Information Center on the web

IMS publications are available in this Eclipse-based information center in both PDF book and

HTML format at http://publib.boulder.ibm.com/infocenter/imzic A locally installable version of

the Information Center can be installed on a computer or intranet server and is available from the

IBM Publications Center See the topic “Installable Information Center” in the IMS Information

Center for details

For customers who are unfamiliar with using the Information Center, animated tutorials are

available that describe how to use the features of the Information Center See the topic “Learn to

Use the Information Center” in the IMS Information Center

Other IMS documentation, such as IBM Redbooks®publications, white papers,

presen-tations from technical conferences, demos, and more, is available on the IMS home page at

www.ibm.com/ims

Hardware and Software Requirements for IMS

This section briefly describes the hardware and software that IMS requires For complete

details about the hardware and software requirements and compatibility of IMS releases with

versions of the operating system and associated products, see the Release Planning publication

for each release of IMS Release Planning publications are available in the IMS Information

Center

Hardware

IMS runs on all IBM processors that are capable of running z/OS IMS can run on either 64-bit

processors or 32-bit processors

For all system libraries and working storage space, any device that is supported by the

operating system is allowed

For IMS database storage, any device that is supported by the operating system is allowed

within the capabilities and restrictions of basic sequential access method (BSAM), queued

sequential access method (QSAM), and virtual storage access method (VSAM)

Software

Each release of IMS requires a minimum z/OS level There are also minimum release levels for

the following base elements of z/OS, which cannot be ordered separately:

• Data Facility Storage Management System (DFSMS)

• SMP/E

• JES2

• JES3

• TSO/E

There are also minimum release levels for the following elements:

• IBM High-Level Assembler Toolkit, a separately orderable feature of z/OS

• z/OS Security Server RACF®, or an equivalent product, if security is used RACF is

available with the IBM SecureWay Security Server for z/OS, a separately orderable

fea-ture of z/OS

• ISPF

• z/OS Communications Server, if IMS TM is used

• IRLM (internal resource lock manager)

IMS also operates in a virtual machine (VM) under the control of z/OS This environment is

intended for use in a program development, testing, or non-XRF production environment

CICS Subsystems Supported

IMS DB can be connected (using the IMS database resource adapter) to CICS, and IMS TM can

be connected (using the appropriate TM interface) to CICS Minimum CICS levels are

docu-mented in the Release Planning publications.

DB2 Subsystems Supported

IMS TM can be connected to DB2 products Supported DB2 products and release levels are

doc-umented in the Release Planning publications.

IMS Development Language

IMS is written in High Level Assembler, PL/X (an internal IBM development language), C, C++,

and Java

Application Programming Languages Supported

You can write IMS applications in the current versions of the following languages:

• Ada

• COBOL for OS/390 & VM

• Enterprise COBOL for z/OS

• Enterprise PL/I for z/OS

• IBM High Level Assembler for z/OS & Java & z/VSE®

• Java, using the IBM 31-bit SDK for z/OS, Java Technology Edition

• PL/I for z/OS and OS/390

• TSO/E REXX

• VS Pascal

• WebSphere Studio Site Developer

• z/OS C/C++

These products require the IBM Language Environment for z/OS: COBOL for OS/390 & VM,

and PL/I for z/OS and OS/390