Next Page Previous Page Home Tools & Aids Search Handbook
1. Exploratory Data Analysis
1.3. EDA Techniques
1.3.3. Graphical Techniques: Alphabetic
1.3.3.13. Histogram

1.3.3.13.2. Histogram Interpretation: Symmetric, Non-Normal, Short Tailed

 
  For a symmetric distribution, the "body" of a distribution refers to the "center" of the distribution--commonly that region of the distribution where most of the probability resides--the "fat" part of the distribution. The "tail" of a distribution refers to the extreme regions of the distribution--both left and right. The "tail length" of a distribution is a term which indicates how fast these extremes approach zero.

For a short-tailed distribution, the tails approach zero very fast. Such distributions commonoly have a truncated ("sawed-off") look. The classical short-tailed distribution is the uniform (= rectangular) distribution in which the probability is constant over a given range and then drops to zero everywhere else--we would speak of this as having no tails, or extremely short tails.

For a moderate-tailed distribution, the tails dive to zero in a "moderate" fashion. The classical moderate-tailed distribution is the norma (= Gaussian) distribution.

For a long-tailed distribution, the tails dive to zero very slowly--and hence one is apt to see probability a long way from the body of the distribution. The classical long-tailed distribution is the Cauchy distribution.

In terms of tail-length, the histogram shown above would be characteristic of a "short-tailed" distribution.

The "who-cares" of all of the above tail-length discussion is the little-known statistical fact that the choice of the optimal (unbiased and most precise) estimator for location for the center of a distribution is heavily dependent on the tail-length of the distibution. The common choice of taking n observations and using the calculated sample mean as our best estimate for the center of the distribution makes perfect sense for the normal distribution (moderate-tailed), but is a poor choice for the uniform distribution (short-tailed), and is a horrible choice for the Cauchy distribution (long-tailed). Although for the normal distribution, the sample mean is as "tight" (precise) an estimator as we can get, for the uniform and Cauchy distributions, the sample mean is unduly noisy (variable)--other location estimators exist which give much better (more precise) estimates of location--for the same amount of data.

If you have a sample of n observations from a uniform distribution, then do not use the sample mean; do use the sample midrange:

sample midrange = (smallest + largest) / 2

The resulting calculated value will be much closer to the truth (the population mean). If you have a Cauchy distribution, then also do not use the sample median; do instead use the sample median:

sample median = the middle observation
        of the n ordered data (if n odd).
sample median = the average of the 2 middle
        observations of the n ordered data
        (if n even).

Recommended Next Step

1. Do a uniform probability plot to check
     uniformity--if linear, then uniform.
2. Do a Tukey Lambda PPCC plot to determine
     the best-fit symmetric distribution--
     look for the curve max which indicates
     the distribution with the most linear
     probability plot.

Home Tools & Aids Search Handbook Previous Page Next Page