Portals eNewsletters Web Seminars dataWarehouse.com DM Review Magazine
DM Review | Covering Business Intelligence, Integration & Analytics
   Covering Business Intelligence, Integration & Analytics Advanced Search

View all Portals

Scheduled Events

White Paper Library
Research Papers

View Job Listings
Post a job


DM Review Home
Current Magazine Issue
Magazine Archives
Online Columnists
Ask the Experts
Industry News
Search DM Review

Buyer's Guide
Industry Events Calendar
Monthly Product Guides
Software Demo Lab
Vendor Listings

About Us
Press Releases
Advertising/Media Kit
Magazine Subscriptions
Editorial Calendar
Contact Us
Customer Service

Information Management:
The Noise is Terrific

  Column published in DM Review Magazine
December 2004 Issue
  By Bill Inmon

Consider early cavemen. How did cavemen receive information? Perhaps they received it orally from their fellow cavemen or maybe by drums, and certainly from claps of thunder that signaled the arrival of a storm. However, despite all the sources of information, the arrival of it was quite infrequent. We can imagine that cavemen welcomed the stimulation of new information.

Fast forward to 1950. How did mankind receive information in 1950? Well, we had newspapers, radio and we were just beginning to have television. We had signs on the motorway and billboards in the city. We had grocery store shelves stocked with goods. The ways that we received information and the rate at which that information flowed had increased dramatically over anything the cavemen had ever known.

What about today? We have the telephone, fax, television, radio, billboards, mail, the grocery store and many, many other ways in which we receive messages. In fact, we have reached the point of overload. We receive so many messages so fast that if any of them penetrate our memory and remain there for more than a minute, it is something of a miracle.

Consider the Internet. The Internet has a peculiar way of delivering messages at an unprecedented rate. Furthermore, these messages can be long and complex, and they are often personal.

The other day, I was having a conversation with my good friend John Zachman. John told me that he has effectively given up even looking at the Internet. He said that the rate at which messages arrived through the Internet exceeded his capacity to read and assimilate them; therefore, he only looks at the Internet occasionally. And John points out that Alvin Toffler predicted this years ago - in Future Shock.

Whether we have reached the point of information overload or not, the potential for overload is there. It is simply true that computers - used in their many forms - can create information faster than we can absorb it.

How should we cope with information overload?

The first clues as to how we can cope with information come to us from the structured environment. Following are some of the approaches that the folks in the structured environment used to cope with the reams of data that were generated:

  • Summarize data - do not look at every single record.
  • Organize data - separate data into meaningful categories.
  • Create thresholds - only pay attention to data when a predetermined threshold has been created.
  • Edit data - remove unnecessary or extraneous data.
  • Periodically deliver data - do not report data or even make data accessible as soon as possible. Give the data some amount of time to "settle" before it is introduced to the public.
  • Arrange data into a hierarchy - create a means of arranging data so that the most interesting data appears easily and the most mundane data is stored where it is not particularly easy to access.

These approaches and more are used as a matter of course by the IT professional to manage the flood of data that is generated as a byproduct of today's day-to-day business. But will these techniques help us to cope with the unstructured data that comes to us from the world of e-mails and the Internet? Probably not. In order to deal with the world of unstructured data, it is necessary to have a whole new filtering technology that can both read unstructured data and manipulate the data after it is read.

Reading unstructured data is merely the first step in starting to filter it out. After the unstructured data is read, it needs to be edited and prioritized. The problem is that the unstructured data is exactly that - unstructured. There is no structure or format for the data; therefore, getting a handle on what is important and what is not important is no small feat.


For more information on related topics visit the following related portals...
Data Management, Enterprise Information Management and Unstructured Data.

Bill Inmon is universally recognized as the father of the data warehouse. He has more than 35 years of database technology management experience and data warehouse design expertise. His books have been translated into nine languages. He is known globally for his seminars on developing data warehouses and has been a keynote speaker for many major computing associations. For more information, visit www.inmongif.com and www.inmoncif.com. Inmon may be reached at (303) 681-6772.

Solutions Marketplace
Provided by IndustryBrains

Speed Databases 2500% - World's Fastest Storage
Faster databases support more concurrent users and handle more simultaneous transactions. Register for FREE whitepaper, Increase Application Performance With Solid State Disk. Texas Memory Systems - makers of the World's Fastest Storage

Backup SQL Server or Exchange Continuously
FREE WHITE PAPER. Recover SQL Server, Exchange or NTFS data within minutes with TimeSpring?s continuous data protection (CDP) software. No protection gaps, no scheduling requirements, no backup related slowdowns and no backup windows to manage.

Manage Data Center from Virtually Anywhere!
Learn how SecureLinx remote IT management products can quickly and easily give you the ability to securely manage data center equipment (servers, switches, routers, telecom equipment) from anywhere, at any time... even if the network is down.

Design Databases with ER/Studio: Free Trial
ER/Studio delivers next-generation data modeling. Multiple, distinct physical models based on a single logical model give you the tools you need to manage complex database environments and critical metadata in an intuitive user interface.

Free EII Buyer's Guide
Understand EII - Trends. Tech. Apps. Calculate ROI. Download Now.

Click here to advertise in this space

View Full Issue View Full Magazine Issue
E-mail This Column E-Mail This Column
Printer Friendly Version Printer-Friendly Version
Related Content Related Content
Request Reprints Request Reprints
Site Map Terms of Use Privacy Policy
SourceMedia (c) 2006 DM Review and SourceMedia, Inc. All rights reserved.
SourceMedia is an Investcorp company.
Use, duplication, or sale of this service, or data contained herein, is strictly prohibited.