Portals eNewsletters Web Seminars dataWarehouse.com DM Review Magazine
DM Review | Covering Business Intelligence, Integration & Analytics
   Covering Business Intelligence, Integration & Analytics Advanced Search
advertisement

RESOURCE PORTALS
View all Portals

WEB SEMINARS
Scheduled Events

RESEARCH VAULT
White Paper Library
Research Papers

CAREERZONE
View Job Listings
Post a job

Advertisement

INFORMATION CENTER
DM Review Home
Newsletters
Current Magazine Issue
Magazine Archives
Online Columnists
Ask the Experts
Industry News
Search DM Review

GENERAL RESOURCES
Bookstore
Buyer's Guide
Glossary
Industry Events Calendar
Monthly Product Guides
Software Demo Lab
Vendor Listings

DM REVIEW
About Us
Press Releases
Awards
Advertising/Media Kit
Reprints
Magazine Subscriptions
Editorial Calendar
Contact Us
Customer Service

Meta Data & Knowledge Management:
MME Best Practices Case Study Allstate Insurance, Part 3

  Column published in DM Review Magazine
April 2005 Issue
 
  By David Marco

This column is adapted from the book Universal Meta Data Models by David Marco & Michael Jennings, John Wiley & Sons, 2004.

In part two of this five-part series on Allstate's managed meta data environment (MME), I walked through their MME's overall technical solution and the role of data stewardship at Allstate (see the March issue of DM Review). In this installment, I will discuss the details of the meta data sourcing layer component of their MME.

Allstate has many different meta data sources that are brought into their MME. These sources include: logical data models, physical data models, codes, logical-to-physical data mapping and messaging for EAI.

Logical Data Models: One primary means of populating meta data in Allstate's MME is through the process of logical data modeling. Application development teams engage (and fund) the data administrator to help identify and model the entities, attributes, relationships and constraints on their data. They also create English-readable names and definitions for entities, attributes and nonenumerated domains. A data model is then created in one of the popular modeling tools, extracted and "checked into" the MME.

To accomplish the import, Allstate defined an XML schema that represents the data in the repository. An import utility was created to take that XML schema and load it into the repository. Whenever they need to get data into the repository, they just create a file or extract one from another tool in their standard format, and then the load can be easily accomplished.

Physical Data Models: Technical meta data describing the physical structure of data is extracted directly from the source database systems files. This process is relatively straightforward because an extraction of meta data (database, table, column and keys) is made from the database system files. Then, it is loaded into the MME through the meta data integration layer.

Codes: Another major source of meta data is from the codes analysts and their use of the codes management system application. The codes analysts research and document any data found to be in codes, creating new enumerated domains to represent the codes when needed, but with a focus on the reuse of existing domains whenever possible.

Codes analysts often find that the same data in two different applications is represented in two entirely different ways. This extends not only to the naming of the fields or columns, but also to both the codes and the values as well. The codes analyst will document the codes and business values used for each of the applications as well as the physical representation of the code for each. These distinct physical representations are called collections.

An enumerated domain can have one or more collections associated with it. The collections are different ways in which the information that a particular domain represents is implemented across the enterprise. The codes analysts will often designate one of the collections as "preferred" and encourage any new use of that domain to use that particular physical representation. The important thing, however, is to ensure, through rigorous definition of the domains, that what is actually the same data is not mistakenly represented by two different domains.

Logical-to-Physical Data Mapping: One of the most manual exercises involved in the population of the MME is the data mapping function for Allstate's data warehouse environment. Mapping is what allows data warehouse users to view what normally would be difficult-to-read physical column names (technical meta data) as easy-to-read logical names (business meta data). It also allows the business definitions for entities and attributes captured in the logical model to be viewed by the data warehouse users.

Mapping is performed by a data warehouse analyst primarily in two cases. The first is to map the physical and logical structures together. Through the MME, analysts simply access the meta data repository to pull up a list of tables on one side of the screen and a list of entities on the other, and proceed to match table/columns with entity/attributes. This "tie" is then captured in the MME. The second type of mapping is where table join keys are identified in different tables and "mapped" together.

Messaging for EAI: In any Global 2000 company or large government agency, system integration is always a major concern. Over the years, Allstate has successfully implemented many point-to-point systems; however, this approach is expensive to maintain.

Now at Allstate, instead of this point-to-point approach, messages deemed to be of interest or significance to the enterprise are now defined, and the meta data about those messages is stored in the MME. This capability allows an existing application to only perform one translation, from its own internal format (for the message content) to the "common" Allstate format for a given event, and it will be able to communicate with all other applications that use the same event. Likewise, a receiving application simply needs to translate from the common format to its own format to process the event. XML is used as the transportation syntax, and XML tag names are assigned to each item of data that the message contains.

The common messages are created through analysis of the two applications seeking to exchange the message with a focus toward the reuse of the message throughout Allstate's other applications. This process ensures consistency and reusability of these common messages. In addition, it leverages the codes information stored in the MME. When two applications exchange a message that contains codes, typically two different coding schemes are being utilized. While the message is being created, a new common code translation is used in these cases. All applications write code that either translates from their collection to the common collection or from the common collection to theirs, depending on their need. This eliminates point-to-point solutions and allows greater reusability of the messages across the enterprise.

Next month, I will present the details of Allstate's meta data delivery layer component of their MME. 

...............................................................................

Check out DMReview.com's resource portals for additional related content, white papers, books and other resources.

David Marco is an internationally recognized expert in the fields of enterprise architecture, data warehousing and business intelligence and is the world's foremost authority on meta data. He is the author of Universal Meta Data Models (Wiley, 2004) and Building and Managing the Meta Data Repository: A Full Life-Cycle Guide (Wiley, 2000). Marco has taught at the University of Chicago and DePaul University, and in 2004 he was selected to the prestigious Crain's Chicago Business "Top 40 Under 40."  He is the founder and president of Enterprise Warehousing Solutions, Inc., a GSA schedule and Chicago-headquartered strategic partner and systems integrator dedicated to providing companies and large government agencies with best-in-class business intelligence solutions using data warehousing and meta data repository technologies. He may be reached at (866) EWS-1100 or via e-mail at DMarco@EWSolutions.com.

Solutions Marketplace
Provided by IndustryBrains

Data Validation Tools: FREE Trial
Protect against fraud, waste and excess marketing costs by cleaning your customer database of inaccurate, incomplete or undeliverable addresses. Add on phone check, name parsing and geo-coding as needed. FREE trial of Data Quality dev tools here.

Backup SQL Server or Exchange Continuously
FREE WHITE PAPER. Recover SQL Server, Exchange or NTFS data within minutes with TimeSpring?s continuous data protection (CDP) software. No protection gaps, no scheduling requirements, no backup related slowdowns and no backup windows to manage.

Manage Data Center from Virtually Anywhere!
Learn how SecureLinx remote IT management products can quickly and easily give you the ability to securely manage data center equipment (servers, switches, routers, telecom equipment) from anywhere, at any time... even if the network is down.

Design Databases with ER/Studio: Free Trial
ER/Studio delivers next-generation data modeling. Multiple, distinct physical models based on a single logical model give you the tools you need to manage complex database environments and critical metadata in an intuitive user interface.

Free EII Buyer's Guide
Understand EII - Trends. Tech. Apps. Calculate ROI. Download Now.

Click here to advertise in this space


View Full Issue View Full Magazine Issue
E-mail This Column E-Mail This Column
Printer Friendly Version Printer-Friendly Version
Related Content Related Content
Request Reprints Request Reprints
Advertisement
advertisement
Site Map Terms of Use Privacy Policy
SourceMedia (c) 2006 DM Review and SourceMedia, Inc. All rights reserved.
SourceMedia is an Investcorp company.
Use, duplication, or sale of this service, or data contained herein, is strictly prohibited.