Portals eNewsletters Web Seminars dataWarehouse.com DM Review Magazine
DM Review | Covering Business Intelligence, Integration & Analytics
   Covering Business Intelligence, Integration & Analytics Advanced Search

View all Portals

Scheduled Events

White Paper Library
Research Papers

View Job Listings
Post a job


DM Review Home
Current Magazine Issue
Magazine Archives
Online Columnists
Ask the Experts
Industry News
Search DM Review

Buyer's Guide
Industry Events Calendar
Monthly Product Guides
Software Demo Lab
Vendor Listings

About Us
Press Releases
Advertising/Media Kit
Magazine Subscriptions
Editorial Calendar
Contact Us
Customer Service

Meta Data & Knowledge Management:
Data Assurance Road Map, Part 1

  Column published in DM Review Magazine
December 2004 Issue
  By David Marco

Data is the lifeblood of any organization. In fact, there isn't a single company in the Global 2000 that would be able to function if you removed the data from their applications. However, the vast majority of these companies and large government organizations are grappling with how to properly manage their data.

The state of data management and data assurance can best be classified as abysmal. Most organizations are overrun with needless data redundancy, very poor data quality and minimal data understanding. Often, these same companies need to establish accountability for the information about their business to meet various constraints placed upon their industry by government regulations, international standards or industry-specific codes of practice. These regulations make data and data assurance everyone's business. Examples include: the ACORD Life standard in insurance for consistency in life, annuity and health products; HIPAA in healthcare for accurate identification of private patient information; and Basel II in banking for accurate enterprise risk analysis. In many cases, bad data equals noncompliance.

Data Assurance Stumbling Blocks

Many organizations do attempt some semblance of a data assurance effort. However, there are several reoccurring themes that stymie these efforts, including:

  • Lack of a cross-functional, dedicated team for data assurance.
  • Not involving the business community.
  • Failure to establish a formal data stewardship organ ization and data quality program.
  • Lack of an enterprise meta data management program.
  • Believing that maintaining the status quo is acceptable.
  • Believing that you do not need data standards to achieve accountability.
  • Poor planning, lack of upfront understanding and execution.
  • Ignoring the enterprise ramifications by creating redundant data silos.

Road Map

While all data assurance projects have their own unique characteristics, Figure 1 represents the common road map of data assurance events for most data integration initiatives (e.g., data warehousing, master data management, application consolidation, etc.). The six key phases of the data assurance road map used to implement successful data integration projects are:

  • Set/Refine Objectives: What are the business objectives?
  • Data Assessment: Where are we currently?
  • Data Alignment: Where are we going (end state)?
  • Data Harmonization: How do we get there?
  • Solution Implementation: Implement the processes.
  • Continuous Improvement: Feedback to refine and extend.

Figure 1: Data Assurance Road Map

Set/Refine Objectives: The first step is to initially set the business objectives of the proposed solution. This involves the participation of the data assurance team in helping to define the strategic objectives and plan for the entire project. This plan includes the requirements for information, priorities, plans, issues (open and resolved), metrics, sponsorship, terminology, capabilities and limitations. From the IT side, it contains the technical aspects of the information architecture, including the infrastructure standards, the enterprise applications, sources of data and organizational understanding.

Data Assessment: The goal of the data assessment phase is to assess the current state of the data. During this process, business and technical intelligence will be gathered to produce a source business model report. This report maps out source elements, where they are located, how much of the data element exists (number of occurrences) and what they mean. In addition, the report details the data inconsistencies and quality issues in the data sources. This report will help to bring into focus the metrics and standards defined in the set/refine objectives phase and determine suitable benchmarks and processes for the subsequent data alignment, data harmonization and solution implementation phases.

Data Alignment: The data alignment phase identifies the desired "end" state of the organization. It is during this time that the key business users define their specific data assurance rules for each of the relevant data elements that have been targeted by the project. Data alignment is responsible for establishing a defined level of accuracy. For example, when an organization constructs the extract, transform and load (ETL) process of a data warehouse, business users must first define the percentage of errors that they will allow (tolerance levels) for the data warehouse load to be considered of sufficient quality.

Next month, I will conclude this two-part series by walking through the data harmonization, solution implementation and continuous improvement phases of the data assurance road map.1

1. This column is based on the "How to Design and Deliver an Effective Data Assurance Solution" white paper. Please visit www.EWSolutions.com to download a free copy of the paper.


For more information on related topics visit the following related portals...
Data Management.

David Marco is an internationally recognized expert in the fields of enterprise architecture, data warehousing and business intelligence and is the world's foremost authority on meta data. He is the author of Universal Meta Data Models (Wiley, 2004) and Building and Managing the Meta Data Repository: A Full Life-Cycle Guide (Wiley, 2000). Marco has taught at the University of Chicago and DePaul University, and in 2004 he was selected to the prestigious Crain's Chicago Business "Top 40 Under 40."  He is the founder and president of Enterprise Warehousing Solutions, Inc., a GSA schedule and Chicago-headquartered strategic partner and systems integrator dedicated to providing companies and large government agencies with best-in-class business intelligence solutions using data warehousing and meta data repository technologies. He may be reached at (866) EWS-1100 or via e-mail at DMarco@EWSolutions.com.

Solutions Marketplace
Provided by IndustryBrains

Data Validation Tools: FREE Trial
Protect against fraud, waste and excess marketing costs by cleaning your customer database of inaccurate, incomplete or undeliverable addresses. Add on phone check, name parsing and geo-coding as needed. FREE trial of Data Quality dev tools here.

Speed Databases 2500% - World's Fastest Storage
Faster databases support more concurrent users and handle more simultaneous transactions. Register for FREE whitepaper, Increase Application Performance With Solid State Disk. Texas Memory Systems - makers of the World's Fastest Storage

Manage Data Center from Virtually Anywhere!
Learn how SecureLinx remote IT management products can quickly and easily give you the ability to securely manage data center equipment (servers, switches, routers, telecom equipment) from anywhere, at any time... even if the network is down.

Design Databases with ER/Studio: Free Trial
ER/Studio delivers next-generation data modeling. Multiple, distinct physical models based on a single logical model give you the tools you need to manage complex database environments and critical metadata in an intuitive user interface.

Free EII Buyer's Guide
Understand EII - Trends. Tech. Apps. Calculate ROI. Download Now.

Click here to advertise in this space

View Full Issue View Full Magazine Issue
E-mail This Column E-Mail This Column
Printer Friendly Version Printer-Friendly Version
Related Content Related Content
Request Reprints Request Reprints
Site Map Terms of Use Privacy Policy
SourceMedia (c) 2006 DM Review and SourceMedia, Inc. All rights reserved.
SourceMedia is an Investcorp company.
Use, duplication, or sale of this service, or data contained herein, is strictly prohibited.