FREE DM Review Site Registration!
Sign-up today and access DM Review on the Web!

Your FREE registration entitles you to:

FREE email newsletters

FREE access to all DM Review content

FREE access to web seminars, resource portals, our white paper library and more!

   

Publisher reserves the right to serve qualified requesters only.

What are some of the factors that influence an organization's satisfaction with its data warehouse?


Q:

What are some of the factors that influence an organization's satisfaction with its data warehouse?

 

A:

Evan Levy's Answer:

  1. User self-sufficiency with data. The ability of business users to answer questions (and take actions) without IT support (i.e., user self sufficiency)
  2. Supporting business action. The ability for an organization to take action to address a business situation knowing there is data to support that decision.
  3. Management's perception of the financial benefits. Ultimately, the data warehouse needs to support the business in one of two ways: generating new revenue or reducing costs. Specific business experiences or successes are always valuable.

Danette McGilvray's Answer: Let's define the phrase "organization's satisfaction" to mean "customer satisfaction." While an organization could be seen as the customer, the real customers of the data warehouse are the actual people who use the data from the warehouse to make decisions and do their jobs. The question becomes "how satisfied are those customers who use the data warehouse?" I use the word customers instead of users to focus attention on the fact that the individual knowledge workers have to be satisfied in order for the organization to be satisfied. So what factors influence the individual customer's satisfaction?

Usage - Who is actually using the data warehouse? How many? How often? For what purposes?
Understanding - Do the knowledge workers know how to use the warehouse? Do they know what data is available to them? Do they have a correct understanding of the data available to them? Do they know how to use the data in their jobs?
Relevance
- Does the data warehouse contain the information the knowledge workers need to do their jobs?
Accessibility
- Is the data easy to access? Do they know how to access the data? Timeliness - Is the data updated in a timely manner that meets the needs of the data warehouse customers?
Quality
- Do the knowledge workers trust the data? Does the quality of the data in the warehouse meet their requirements? Is the data in the warehouse an accurate reflection of the real world and transactions that are feeding the warehouse?
Training and Documentation
- Were the knowledge workers trained in all factors of the data warehouse discussed above? Do they need follow-up training? Is documentation accessible, up to date and easy to understand? The bottom line factor is
Usefulness
- Does the data warehouse help the knowledge workers make better decisions and do their jobs more effectively? Is it meeting their requirements and expectations?

Keep in mind that there are several types of customer who use the data warehouse: They could fall into the following broad categories: power users - technically sophisticated analysts, business analysts and casual users who use the data warehouse only occasionally. Other customers may never access the data directly themselves, but use the data that others have accessed for them. Different types of customers may have different levels of satisfaction. There is another aspect of satisfaction and that is from the support point of view - those who obtain data, load data, support the hardware and software, etc. Are those who are supporting the data warehouse satisfied with how the data warehouse is operating? Are those receiving support satisfied? Go back to the original project charter - Is the data warehouse fulfilling the original requirements? Did the requirements change and did the data warehouse change to meet the new requirements?

Les Barbusinski's Answer: The key factors to user and management satisfaction with any data warehousing or business intelligence solution are as follows (in order of importance):

  • Relevance
  • Reliability
  • Accuracy
  • Performance
  • Ease of Use
  • Flexibility
  • Cost Effectiveness

Relevance means that the data warehouse, data mart, dashboard or BI application performs a significant service for the target department, business unit or enterprise (i.e. it fulfills a business need). Reliability means that the DW/BI application is regularly available during normal business hours, and behaves in a predictable manner (i.e., it does not exhibit frequent aborts or experience serious and/or chronic downtime). Accuracy means that the application presents a complete and correct picture of whatever portions of the enterprise it measures (i.e., users feel comfortable making serious business decisions based on the information contained in the data warehouse). Performance means that the application's ETL and reporting processes perform their tasks in a timely and efficient manner (i.e., it does not keep the users waiting). Ease of use means that the online interface to the data warehouse (usually a portal with embedded BI and reporting functions) is intuitive, easy to navigate and allows users to become productive quickly. Flexibility means that the information content and/or analytic capabilities of the data warehouse can be easily extended and/or modified to keep up with evolving business needs. And finally, cost effectiveness means that new releases of the DW/BI application exhibit a high-level of ROI, and on-going maintenance costs are reasonable and reflective of the business benefit provided by the application. Hope this helps.

Sid Adeleman's Answer: The factors are:

  • Data quality
  • Performance Availability
  • User support
  • Comfort with the BI tool
  • Ability to respond to new requests

However, the most important factors relate to the organization's expectations and to the degree those expectations are fulfilled. This means that these expectations must be managed early and often.

It's important that you regularly measure satisfaction so you know what needs fixing. I suggest you measure three or four time each year. This is a user satisfaction survey taken from the book Data Warehouse Project Management by Sid Adelman and Larissa Moss.

Note: To increase the percentage of questionnaires returned, bribes and guilt can be useful. Movie passes, tickets to sports events or entry in a drawing will increase the number of responses. You can either clip the movie passes to the questionnaire (guilt approach) or send the passes when the questionnaires are returned. Some users will want to remain anonymous or they may nor be so condid if their identity is known and so clipping the bribe to the questionnaire is more appropriate.

This is an example of an assessment form.

Larissa Moss' Answer: A data warehouse is well received and continuously funded when the business community knows (has measured results) that the data warehouse has greatly increased the speed and quality of information used by the business community to make better and faster decisions about its business. That means that all data warehouse projects (and deliverables) must support the company's expressed business goals, and that data warehouse usage to achieve those goals is measurable and measured. It also means that data warehouse usage is deeply embedded into the business operations as a critical component to running and managing the business. This involves increased user participation before, during, and after the construction of the data warehouse deliverables. When users participate actively in building the data warehouse, they become intimately familiar with its components (data elements, data quality, ETL process, OLAP capabilities, etc.). This facilitates user ownership of the data warehouse, training of how to use the data warehouse, promoting the data warehouse. Bottom line, the two critical factors are: supporting a stated business goal and user participation in all aspects of each project. 


Sid Adelman is a principal in Sid Adelman & Associates, an organization specializing in planning and implementing data warehouses, in data warehouse and BI assessments, and in establishing effective data architectures and strategies. He is a regular speaker at DW conferences. Adelman chairs the "Ask the Experts" column on www.dmreview.com. He is a frequent contributor to journals that focus on data warehousing. He co-authored Data Warehouse Project Management and is the principal author on Impossible Data Warehouse Situations with Solutions from the Experts and Data Strategy. He can be reached at (818) 783-9634 or visit his Web site at www.sidadelman.com.

Larissa Moss is founder and president of Method Focus Inc., a company specializing in improving the quality of business information systems. She has more than 20 years of IT experience with information asset management. Moss is coauthor of three books: Data Warehouse Project Management (Addison-Wesley, 2000), Impossible Data Warehouse Situations (Addison-Wesley, 2002) and Business Intelligence Roadmap: The Complete Project Lifecycle for Decision- Support Applications (Addison-Wesley, 2003). Moss can be reached at methodfocus@earthlink.net.

Les Barbusinski is vice president of technology and co-founder of Digital Symmetry, LLC, a consulting firm that specializes in the design and development of data warehousing and business intelligence solutions. He has more than 20 years of experience in data warehouse and operational systems development and provides hands-on expertise in data warehouse design, development and project management. Les can be reached at dwexpert@dsym.com.

Evan Levy is a partner and co-founder of Baseline Consulting Group, a multivendor systems integration and consulting firm. As the partner in charge of Baseline’s largest practice, Levy leads both executives and practitioners in delivering technology solutions that help business users make better decisions. He has led strategic technology implementations at commercial and public sector organizations and advises vendors on their product development and delivery strategies. Levy has been published in a wide array of industry magazines and has lectured on a range of technology delivery experiences at leading conferences and vendor events. He has been a featured speaker at the Marcus Evans Analytical CRM symposium, DCI’s Data Warehousing conference, the CRM Association, DAMA International, the AMA and the Data Warehousing Institute. His current work involves delivering and lecturing extensively on the topic of data integration. You can contact him at evanlevy@baseline-consulting.com.

Danette McGilvray is president and principal of Granite Falls Consulting, Inc., a firm specializing in information quality management to support key business processes around customer satisfaction, decision support and operational excellence. Projects include enterprise data integration programs, data warehousing strategies and best practices for large-scale ERP data migrations for Fortune 50 organizations. For more than ten years she led information quality initiatives at Hewlett-Packard and Agilent Technologies. An accomplished program manager and facilitator, she is an internationally respected expert on data profiling, metrics, quality, audits, benchmarking, and tool acquisition and implementation. McGilvray is an invited speaker at conferences throughout the U.S. and Europe, where she trains other industry experts in enterprise information management and data stewardship. You can reach her at danette@gfalls.com.

For more information on related topics, visit the following channels:



Industry Vendors