Ó 2004, S. D. Cochran. All rights reserved.

SUMMARIZING DATA NUMERICALLY  

  1. In this next section we are going to learn how summarize data by calculating an estimate of the average value in a distribution and an estimate of how much the values in the distribution cluster around that average.
  2. What is meant by average? There are three ways of defining average. 
  1. One way of thinking about average is what is the most common event. The most common event is call the mode. From this we get the word, modal.  

    So the modal student in this class is a sophomore. That is the year in school that is most commonly represented in this class is a sophomore. 

    But the mode tells us nothing about the rest of the distribution. For example, it does not tell us whether sophomores make up most of the class, that is more than 50%, or get their label as modal because they just squeak by the rest at 26%. 

    Example: Imagine the following ages of 6 children: 6, 5, 7, 6, 6, 5. The modal age is 6. It is the most common age among the children. 

  1. A second way of thinking about average is to look at what is the middle of the distribution. This is called the median. The median is that point at which 50% of the distribution lies above and 50% lies below. 

      Example: In a second group of 6 children there were the following ages: 5, 9, 11, 6, 3, 1. If we arrange the ages in numerical order we can see that half are 5 and below; half are 6 and above so the median age is 5.5 years 

      The median gives us a clear sense of the middle of the distribution but often times it is a general sense rather than a precise sense.  

    1. A third way of thinking about average is the mean. The mean is a weighted sum. We calculate it by summing all the scores and then weighting by the number of scores that contributed to that sum. In that way we control for the size of the sample that contributed scores.  
    2. For example, if we sampled 3000 students or 300 students from UCLA and asked how frequently they exercised, the mean would be very close to the same, because by dividing by the sample size we adjust or weight for that factor. 

      The mathematical formula for the mean is: given a list of n numbers, 

       

      Example: In our first group of children the mean is (6+ 5+7+6+6+5)/6=5.83 

    3. Some final thoughts about the averages
  1. The mean is the balancing point of a distribution, which is something covered extensively in the chapter
  2. If the distribution is symmetric, the mean is equal to the median
  3. The mean is sensitive to extreme values, so if you have a distribution with a long tail to one side, the mean is drawn toward that tail--if the long tail is on the right the distribution is said to be positively skewed; if the long tail is on the left so that many values exist at higher numbers then the distribution is negatively skewed (drawn in the negative direction)--in this case it might be more appropriate to report the median 
  4. Most of you have an intuitive sense of the mean. You can look at two different distributions and know right off that their mean is different. 

      Example: In one of our groups of children the ages were 6, 5, 7, 6, 6, 5. If we had a group of adults with the following ages: 42, 45, 51, 60, 48, do you need to calculate a mean to know that the means are different? Does it matter that one group has 6 elements and one has 5? 

      The next concept you don't have that intuitive feel for yet, but with practice you will. 

C. Measuring spread 

  1. A second way of describing a distribution is to quantify the average spread away from the center of a distribution 
  1. The first step in measuring spread of a distribution is to have in the mind the concept of distance. How far from average are people on average? If everyone is average exactly then nobody differs from average, which is another of saying that everybody is exactly the same and there is no distance between them.  
  2. One way of beginning to quantify distance is the root-mean-square approach 

The formula for the root-mean-square is: 

 

So, in our first group of children's age data we could calculate the r.m.s., which is 5.87. This gives us a type of average of squared ages. 

  1. But what we would really like to know is how far on average is a score from average. To do this we have to calculate the standard deviation. This is abbreviated as S.D., or on many calculators as "s" or "s " (sigma).
  1. One component of the standard deviation, is the deviation from the average. That is how far is a score from the mean. This is simply:
    1. The second step is to take the r.m.s of these deviations.
    2. Or we can do it all at once: 

     

    Example: In our children's age data the S.D. = .69 years 

    1. There are two ways of calculating standard deviation (one of which corrects for problems you are currently unaware of). You now know one of them (the other we will learn later), but most calculators use the formula for the other type of standard deviation. Be sure to check you calculator. Many calculators do directly calculate the standard deviation formula we are using here, sometimes referring to it as s , or lower case sigma. 
    2. The Standard Deviation gives you an additional piece of information about a distribution. It tells you what the spread looks like away from the average. 

    Example: In our two groups of children, their mean ages were equivalent, but if we calculate their S.D.'s Group 1 has an S.D. of .69 years reflecting the fact that all six children had very similar ages. The S.D. of Group 2 is 3.39 reflecting their greater spread away from the mean. 

    1. What is the advantage of knowing the S.D.? As we will learn in the next lecture, one S.D. to the right and left of a mean includes about 68% of a distribution--not always exactly, but generally in the ballpark. Two S.D.'s cuts off about 95% of the distribution. 
    1. Let's go through a real example. Imagine a distribution of U.S. President's ages at the time they are inaugurated. We want to be able to summarize this data in a way where we can give other people a sense of how old are U.S. President's when they take office. 
    1. We could list every element, that is every President, and let people make their own summary judgment, so I might show you the following list of numbers: 

    57,61,57,57,....and so on

    Tell me how old is a president when he takes office? How old were about 2/3 of the presidents when they first entered office? How about 95% of the presidents? 

    1. We could do some of the summary work and make a histogram of their ages 

    Interval.....Count

    40-45..........2

    45-50..........7

    50-55........15

    55-60.........9

    60-65.........7

    65-70.........2

    1. But, we could say most of what we need to know about this distribution in only 2 numbers. That is we could answer those two questions I asked by knowing just 2 numbers. The first is the average and second is the spread.
    2. We know there are 3 types of averages 
    1. The mode or most common element in the distribution. In the president's age raw data the mode is 51. Five men were 51 years old when they took office. No other age was represented this frequently 
       
    2. The median is that point in the distribution that 50% of the ages lie above and below it. In our president's age raw data, the median is 55 years. That is around 50% of men were 55 years or younger when they took office (57%). But you can see here the problem with median. It is also true that around 52% of presidents were 55 years or older when they took office. We could calculate an age within that one year interval to state median more precisely. 
    3. The mean, or numerical midpoint in the distribution. We can calculate the mean of the presidents' age distribution, and we find the following: 

     

    Typically, when people use the word average they are referring to the mean. So we might say that the average U.S. President is 54.8 years when he takes office. But the problem, again with this average is that it doesn't tell us anything about the spread of the distribution. That is, we could have half of these men age 49 years and about half 60 years and still end up with a mean of 54.8 years. 

    1. We can also calculate the average spread around that central point. It is simply the r.m.s of the deviations from the mean. So, in our Presidents' age data, it would be 

     

    1. Knowing these two facts, the average and average spread away from average, I can dazzle you with seemingly awesome predictive powers. 

    If you tell me that on average U.S. President is 54.8 years when he takes office (S.D. = 6.1), I'll tell you, without looking at the data that 68% of Presidents are between the ages of 48.7 (54.8 - 6.1 = 48.6) and 60.9 (54.8 + 6.1 = 61.0). 95% of these men are between the ages of 42.6 and 67.0. The true percentages are 67% age 49 up to and not including 61 years and 93% between 43 and 67 years. I am more accurate, of course by looking at the distribution exactly, but for only using 2 numbers, the mean and the standard deviation, to describe the distribution I am very, very close. This means that with two numbers we can convey to ourselves and others an enormous amount of information.