Tweet

5 Management Mistakes in Using Data

Guest post by: Robert Whipple

Article Overview: Deming taught us that many managers make things worse rather than better by the way they react to data. I would like to hear your opinions on whether you see this in your organization. Here are just 5 reasons why managers use data inappropriately.

5 Management Mistakes in Using Data

W. Edwards Deming had a lot to say about how managers use data incorrectly and waste the resources of an organization. It was part of his philosophy of quality which he called "profound knowledge." He stressed a number of mistakes typically made by managers when handling data. Here are some of the problems along with the antidote for each misuse. Mistake 1 - Assuming variation is a result of special cause variability when it is really due to common cause variability.

Common cause variability is when a system is in statistical control with small random type variation going on. The only way to tell if a system is in control is to consider all the data, usually by plotting it, and find out if the data variability is within certain defined bounds. If it is, then for managers to ask people to explain the variation is simply a waste of time. People will dutifully go off and try to find out what caused the variation, but the answer will be only a guess and not valid information.

When one or more data points go outside the bounds of normal variability, then there is a special cause. In these cases it is not only possible but vital to determine what caused the variation so it can be controlled and eliminated in the future.

Most managers fail to determine if a signal is due to special cause variation when they ask underlings to explain what happened. This causes a large waste of effort and time.

Mistake 2 - Assessing the capability of a process based on the most recent data point.

It is tempting to react to the most recent data and ask people to take corrective action based on that. At home, we might say, it's cold in here, why not turn up the heat? But just because it is cold at the moment does not mean the system needs to be adjusted. It may be the low point of the cycle that is in common cause variation. In which case, if we turn up the thermostat, we are doing what Deming called "tampering." Tampering is defined as moving the set point of a system experiencing common cause variation in an attempt to reduce the variability. In fact, it can be demonstrated that "chasing" the perfect setting will result in a large increase in the variation of the process. It is better to leave things alone.

Many of us have experienced this when sitting in a meeting. All of a sudden someone will say, "Whew, it is very warm in here" and turn down the thermostat. Ten minutes later people in the room are reaching for their sweaters because they are chilled, so up goes the thermostat. All day long people fiddle with the darned thermostat and swear at the heating system. The problem resides in the fingers of the people playing with the setting, not the furnace control. They are tampering, which results in roughly double the temperature variation than if they just left things alone.

Mistake 3 - Interpreting two points as a trend

This flaw is ingrained so deeply into the fabric of our thinking that we rarely even realize how stupid most statements of movement really are. Every day we read in the paper or hear on the news something like the earnings for Company X are up by 20%. We think that is a good thing. Rubbish! All it means is that in comparison to four quarters ago the earnings are 20% higher. It says nothing about the actual trend of the data. For knowledge of how the company is doing we need to plot the data and consider the quarterly earnings over something like 8 consecutive quarters. Then we can know what is going on.

Many advertisements for products are based on the faulty logic that two points make a trend. When we hear that interest rates on mortgages is down by ½ point, that is a symptom of two points equaling a trend. We really cannot use that data to imply what has been happening to interest rates in the past or is likely to happen in the future.

Mistake 4 - Looking for blame rather than root cause

When something goes wrong, managers often focus on who messed up and why rather than what aspect of the system was the root cause so it can be fixed. They think if they can pinpoint the culprit and punish him or her that will eliminate problems in the future. Actually, the reverse is true. By trying to find a scape goat, people tend to hide the truth and work to pin blame on other people to protect their own interests. That leads to infighting and other disruptive behavior.

Mistake 5 - Too much automation of process data.

This issue is counter intuitive. One would think that data plotted and interpreted by computers would be superior to that plotted by hand. In fact, data where people have been involved in the process is more useful because people have the ability to spot peripheral issues and correct them where a computer will just keep logging rubbish. When people rely on the machine always being right, there can be disastrous results because at the root of it the machines are controlled by people, but once programmed, people tend to rely too much on the machine and forget to check for sanity. That is how pilots occasionally fly into the side of a mountain, because they rely too much on the dumb auto pilot and forget to watch where they are going.

These 5 mistakes are the most common ones. There are other symptoms of how managers use data incorrectly to the detriment of their organization and the people. The antidote for each of these problems is to make sure managers are educated on these flaws and modify their behaviors to avoid the pitfalls.

Related Articles
  Major Crisis don't just happen!
  More Data Footprint Reduction (DFR) Material
  Data Loss - The Scariest Term in Business Today
  Using Law Practice Management Software To Protect Your Practice From Liability
  What's Your Excuse for Not Using Data Mining?!
  Data processing Requirements
  Part 8: Financials
  Role of Data Management in Any Type of Business
  Enterprise Content management
  Common Money Management Mistakes That You Need to Avoid
  Lesson #1: “If you get knocked down, get back up again”
  The data storage prayer
  PROGRAM MANAGEMENT PLANNING
  Major Focuses & Principles of Six Sigma Implementation
  Human Resources Management Systems Imports
  How to maintain data privacy?
  Why Use Feedburner for Feeds
  Security Concerns with Cloud Computing Services
  Using Mistakes Successfully
  How and When to Use Exit Interviews

Article Tags: Data, Deming, Leadership, Managers, Mistakes, plot, trend, trust



Related Forum Posts
No B.S. Time Management - A great book I read on Time Management is No B.S. Time Management for Entrepreneurs by Dan Kennedy.
Re: 365 Foolish Mistakes Smart Managers Make - [quote="litekepr":2v18lglp]This morning's Google Alert held a pleasant surprise. WORTH MENTIONING A List of New Books Compiled by The Management and Government Information Center (MAGIC) Chinn Park Regional Library 703-792-4880Summer 2007 Indicates titles relating to the FISH Philosophy 365 Foolish Mistakes Smart Managers Make Every Day: How and Why to Avoid Them by Shri L. Henkel, 2006 interesting. Is anyone else here familiar with the FISH philosphy? i[/quote:2v18lglp] Congrats on the mention of your book! Hopefully it will drive up sales! For myself, I don't really care for their acronym... MAGIC. Gives people the subtle impression that good things happen at the snap of a finger instead of lots of hard work!
Which kind of industries are you interested in? - Ecological or E-business or Investment or Finance or Management or Non-Profit or Retailer or others.
Re: Does Your Website Have a Robots.txt File? - HI Carol, Your robot file is correct; no lets work on your Page Titles & Meta Data. Do you have access to create different page titles for each page of your website? Do you have your FTP information...please do not post it here but just let me know if you have access. Jeff
Re: What I Enjoyed Reading This Week - June 11 - Hi Evan, Thank you for the reading material. I look forward to the general release later this month as outlined in the 'Google Analytics To Add Search Query Data From Webmaster Tools' article. Anything that helps us to understand maximise extra data from Google Analytics can only be of benefit. regards, Mal.


Share this article with your friends. Fund someone's dream.

Leave a comment below or share on the left and you'll help support entrepreneurs in Africa through our partnership with Kiva. Over $50,000 raised and counting - Please keep sharing! Learn more.

Newsletter

Get advice & tips from famous business
owners, new articles by entrepreneur
experts, my latest website updates, &
special sneak peaks at what's to come!

Name:
Email:

Popular Articles

Do You Have An Entrepreneurial Vision?

Pay Per Click Advertising

••••••>SEO Tip Of The Day: HTML Validation

Suggestions

Email us your ideas on how to make our
website more valuable! Thank you Sharon
from Toronto Salsa Lessons / Classes for
your suggestions to make the newsletter
look like the website and profile younger
entrepreneurs like Jennifer Lopez.