Data Architecture: From Zen to Reality

Front Cover......Page 1
Data Architecture......Page 4
Copyright Page......Page 5
Contents......Page 8
Preface......Page 22
SECTION 1 THE PRINCIPLES......Page 26
Defining Architecture......Page 28
Design Problems......Page 31
Patterns and Pattern Usage......Page 32
Concepts for Pattern Usage......Page 33
Information Architecture......Page 36
Structure Works!......Page 37
Problems in Architecture......Page 39
Architectural Solutions......Page 41
The “Form Follows Function” Concept......Page 42
Guideline: Current and Future......Page 44
Data Policy Principles......Page 46
Architecture Frameworks......Page 48
The Zachman Framework for Enterprise Architecture......Page 51
The Open Group Architecture Framework......Page 54
The Federal Enterprise Architecture......Page 58
Conclusions......Page 65
Enterprise Data Architectures......Page 66
Enterprise Models......Page 67
The Enterprise Data Model......Page 68
The Importance of the Enterprise Data Model......Page 69
Object Life Cycles......Page 70
Object Frameworks......Page 71
Object Framework Programming......Page 72
Architecture Patterns in Use......Page 73
TADG Pattern Content......Page 74
IBM Patterns for e-Business......Page 75
Enterprise Data Model Implementation Methods......Page 78
Enterprise-Level Architectures......Page 82
Enterprise Technology Architectures......Page 83
Enterprise Architecture Terminology—Business Terms......Page 84
The Enterprise Data Architecture from a Development Perspective......Page 85
Subject Area Drivers......Page 87
Naming and Object Standards......Page 88
Data Sharing......Page 89
Data Dictionary–Metadata Repository......Page 91
Organizational Control Components......Page 92
Database Administration......Page 93
Setting Up a Database Administration Group......Page 95
Repository Management Areas and Model Management......Page 97
Design Methods......Page 100
Why Do We Need Development Methodologies?......Page 101
Structured Methods......Page 102
Structured Design......Page 104
Structured Analysis......Page 105
Problems with Structured Approaches......Page 106
Personal Computers and the Age of Tools......Page 107
Engineering Concepts Applied......Page 108
The Birth of Information Engineering......Page 109
Information Engineering as a Design Methodology......Page 110
The Synergy of Tools and Information Engineering......Page 112
Problems with Information Engineering......Page 113
Implementing the Best of IE while Minimizing Expense......Page 114
SECTION 2 THE PROBLEM......Page 118
The Problem of Business Evolution......Page 120
Separate Function Communication......Page 121
Manual Data Redundancy......Page 122
Data Planning and Process Planning......Page 124
Corporate Architecture......Page 125
Using Nolan’s Stages of Growth......Page 127
Problems with Older Organizations......Page 128
Business Today......Page 129
When Will It End?......Page 131
What Can We Do about It?......Page 132
Generic Subject Areas for Corporate Architectures......Page 133
Corporate Information Groupings or Functional Areas......Page 135
Corporate Knowledge......Page 139
Purpose and Mission of the Organization......Page 142
Ideology, Mission, and Purpose......Page 143
Design with the Future of the Organization in Mind......Page 145
Generalize for Future Potential Directions......Page 146
Organizational Structure......Page 148
The Information Needs of Management......Page 149
Organizations Don’t Know What They Don’t Know......Page 150
Information Strategy for Modern Business......Page 152
Maximizing the Value of Information......Page 156
Forces in the Organization......Page 161
What Is Information Technology?......Page 164
Trends in Information Technology......Page 165
The Other Option......Page 166
Trends in Organizational Change......Page 167
Explanations for the Anomaly in Productivity......Page 168
Information Technology and Its Impact on Organizations......Page 172
Why Invest in Information Technology?......Page 173
Ineffective Use of Information Technology......Page 174
Other Impediments to Organizational Efficiency......Page 175
Technological Solutions for Information Technology......Page 176
Human Resource Issues in Information Technology......Page 177
Summary......Page 178
Maximizing the Use of Information Technology......Page 179
Downsizing and Organizational Culture......Page 182
Culture Change......Page 183
Organizational-Level Analysis......Page 185
Organizational/Individual-Level Analysis......Page 186
Downsizing’s Impact on Culture......Page 187
Summary......Page 188
Outsourcing......Page 189
Rapid Application Development......Page 193
SECTION 3 THE PROCESS......Page 198
Corporate Data Architecture......Page 200
Architecture Team......Page 201
Scope Definition......Page 202
Data Gathering and Classification......Page 203
Data and Function Integration......Page 204
Procedure Definition via Functional Decomposition......Page 205
New Function Creation......Page 206
Access Path Mapping......Page 207
Application Development Templates......Page 208
The Software Development Methods......Page 209
Architectural Development Methods......Page 210
Entity Process Models......Page 213
The Unified Method......Page 214
What Are Models and How Did They Come About?......Page 216
Data Models Introduction......Page 217
Process Models Introduction......Page 219
How Are Automated Models Developed?......Page 220
How Are Models Retained?......Page 221
Model Repository Policy and Approach......Page 222
Shared Repository Objects......Page 223
Model-Driven Releases......Page 224
Supporting an Application Release......Page 225
Version Type: Participation......Page 226
Seamless Development Control Process......Page 227
Release Stacking......Page 228
Emergency Correction Procedures......Page 229
PTF Implementation for Shared Batch and Online Objects......Page 230
Application Audience and Services......Page 232
Attributes......Page 233
Primary Identifiers......Page 234
Entity Relationship Diagrams......Page 235
Types of Relationships......Page 236
Model Types......Page 237
Primary Keys......Page 241
Normalization......Page 242
Overnormalization......Page 243
Domain Constraints......Page 244
Generic Domain Constraint Constructs......Page 245
Application History......Page 248
Classes and Characteristics......Page 250
Simple History......Page 251
Complex History......Page 252
Logically Modeling History......Page 253
Physical Design of History......Page 254
Physical Implementation of History......Page 255
Finding Patterns......Page 256
Tips and Techniques for Implementing History......Page 257
Types of Systems......Page 258
Physical Structure......Page 260
Dimensional History......Page 262
SECTION 4 THE PRODUCT......Page 264
Cluster Properties......Page 266
Cluster Theory Applied......Page 267
Inserts......Page 269
Physical Structure......Page 270
Key History and Development......Page 271
Foreign Keys......Page 273
Candidate Keys......Page 274
Surrogate Keys......Page 275
High Water Keys......Page 276
Other Specialized Keys......Page 277
How Much Data?......Page 280
Population Quantification of Application Data......Page 281
Concurrency......Page 282
Security/Audit......Page 283
Archive/Purge......Page 285
Recovery/Restart......Page 286
Data Integrity......Page 287
Referential Integrity......Page 288
Data Access......Page 289
Privacy Requirements......Page 290
Three-Level Architecture......Page 292
Data Independence......Page 295
Database Languages......Page 296
Classification of Database Management Systems......Page 297
Factors Impacting Physical Database Design......Page 299
Queries, Reports, and Transactions......Page 300
Utilization Analysis via Process Use Mapping......Page 301
Analysis of Expected Frequency of Insert, Delete, Update......Page 302
Other Physical Database Design Considerations......Page 303
Population on the Database......Page 304
Objectives......Page 306
Interaction Analysis......Page 308
Entity Life Cycle Analysis/Entity State Transition Diagrams......Page 310
Process Dependency Scope and Process Dependency Diagram......Page 312
Event Analysis......Page 313
Changes to ER Models......Page 315
ERD Denormalization......Page 316
Actions on Super Type–Subtype Constructs......Page 318
Actions on Multiple Relationships......Page 319
Resolution of Circular References......Page 320
Resolution of Duplicate Propagated Keys......Page 321
Consolidation of Entities......Page 322
Derived Attributes and Summary Data......Page 323
Implement Repeating Groups......Page 324
Introduce Redundancy......Page 325
Vertical or Horizontal Segmentation......Page 326
Access Path Mapping......Page 327
Conclusion......Page 330
SECTION 5 SPECIALIZED DATABASES......Page 332
Early Analysis in this Area......Page 334
Keen and Scott-Morton......Page 335
Components of Decisions......Page 336
Responsibility......Page 337
Warehouses versus Reporting Databases......Page 339
Structure Evolution......Page 340
Why Can’t OLTP Data Stores Be Used?......Page 341
Warehouse Modeling......Page 342
Warehouse Modeling Depends on Architectures......Page 343
Enterprise-Level Data Architecture......Page 344
The Many Types and Levels of Data......Page 346
Data Modeling: Definitions......Page 347
Logical to Physical Transformation......Page 348
Placement of Models......Page 349
Denormalization and the Dimensional Model......Page 350
What Are the Choices?......Page 351
Applicability of the Dimensional and Relational and Hybrid Models......Page 352
Dimensional Architecture......Page 354
Where Is the Relational Data Warehouse Best Suited?......Page 355
Hybrid ER-Dimensional......Page 356
Building an Enterprise Data Model......Page 358
Standard or Corporate Business Language......Page 360
Conclusion of Hybrid Approach......Page 361
Warehouse Architecture......Page 362
Dimensional Model Concepts......Page 364
Review of Basic Components of Dimensional Models......Page 365
Star Schemas......Page 366
Star Schema Design Approach......Page 367
Structure Design......Page 368
Categorize the Entities......Page 369
Identify Dependency Chains......Page 370
Produce Dimensional Models......Page 371
Options for Dimensional Design......Page 372
Simple Star Schemas......Page 373
Star Schema Clusters......Page 377
Review of Design Options......Page 380
Enterprise Data Warehouses......Page 382
Enterprise Data Warehouse Defined......Page 384
What Are the Important EDW Driving Forces?......Page 385
The Best Practices for EDW Implementation......Page 387
The Top-Down Approach......Page 388
The Bottom-Up Approach......Page 389
The Hybrid Approach......Page 391
Implementation Summary......Page 392
Object Oriented Data Architecture......Page 394
Sample Object Oriented Design Concept: Wiring Money......Page 395
Examples of Different Actions......Page 396
Analogy and Problem Solving......Page 398
Assembler Languages......Page 399
Abstract Data Types......Page 400
Objects with Parameter Passing......Page 401
Object Oriented Architectures Summary......Page 402
Attribute Inheritance......Page 403
Generalization Hierarchies......Page 404
Physical Data Design Considerations......Page 405
Object Identity......Page 406
Summary......Page 407
The Distributed Model......Page 410
How Does It Work?......Page 411
Fragmentation......Page 412
Homogeneous Distributed Model......Page 413
Federated or Heterogeneous Distributed Model......Page 414
Distributed DBMSs......Page 416
Controlled Data Sharing......Page 417
Qualities Required in a DDBMS......Page 418
An Overview of Client Server......Page 419
Functionality within Client Server......Page 420
A Typical DDBMS......Page 421
Types of DDBMSs......Page 422
Individual Site Failure’s Effect on Data Integrity......Page 423
Distributed Deadlocks......Page 424
Summary......Page 425
Index......Page 426