<< Chapter < Page Chapter >> Page >
The mean value locates the center of the probability mass distribution induced by X on the real line. In this unit, we examine how expectation may be used for further characterization of the distribution for X. In particular, we deal with the variance and its square root the standard deviation. We identify some important properties of variance and identify the concept covariance. The variance is calculated for several distributions, comparing analytical and Matlab results.

In the treatment of the mathematical expection of a real random variable X , we note that the mean value locates the center of the probability mass distribution induced by X on the real line. In this unit, we examine how expectation may be used for further characterizationof the distribution for X . In particular, we deal with the concept of variance and its square root the standard deviation . In subsequent units, we show how it may be used to characterize the distribution for a pair { X , Y } considered jointly with the concepts covariance , and linear regression

Variance

Location of the center of mass for a distribution is important, but provides limited information. Two markedly different random variables may have the same mean value.It would be helpful to have a measure of the spread of the probability mass about the mean. Among the possibilities, the variance and its square root, the standard deviation,have been found particularly useful.

Definition . The variance of a random variable X is the mean square of its variation about the mean value:

Var [ X ] = σ X 2 = E [ ( X - μ X ) 2 ] where μ X = E [ X ]

The standard deviation for X is the positive square root σ X of the variance.

    Remarks

  • If X ( ω ) is the observed value of X , its variation from the mean is X ( ω ) - μ X . The variance is the probability weighted average of the square of these variations.
  • The square of the error treats positive and negative variations alike, and it weights large variations more heavily than smaller ones.
  • As in the case of mean value, the variance is a property of the distribution, rather than of the random variable.
  • We show below that the standard deviation is a “natural” measure of the variation from the mean.
  • In the treatment of mathematical expectation, we show that
    E [ ( X - c ) 2 ] is a minimum iff c = E [ X ] , in which case E ( X - E [ X ] ) 2 = E [ X 2 ] - E 2 [ X ]
    This shows that the mean value is the constant which best approximates the random variable, in the mean square sense.

Basic patterns for variance

Since variance is the expectation of a function of the random variable X , we utilize properties of expectation in computations. In addition, we find it expedient to identifyseveral patterns for variance which are frequently useful in performing calculations. For one thing, while the variance is defined as E [ ( X - μ X ) 2 ] , this is usually not the most convenient form for computation. The result quoted above gives an alternate expression.

  • Calculating formula . Var [ X ] = E [ X 2 ] - E 2 [ X ] .
  • Shift property . Var [ X + b ] = Var [ X ] . Adding a constant b to X shifts the distribution (hence its center of mass) by that amount. The variation of the shifted distribution about the shifted centerof mass is the same as the variation of the original, unshifted distribution about the original center of mass.
  • Change of scale . Var [ a X ] = a 2 Var [ X ] . Multiplication of X by constant a changes the scale by a factor | a | . The squares of the variations are multiplied by a 2 . So also is the mean of the squares of the variations.
  • Linear combinations
    1. Var [ a X ± b Y ] = a 2 Var [ X ] + b 2 Var [ Y ] ± 2 a b E [ X Y ] - E [ X ] E [ Y ]
    2. More generally,
      Var k = 1 n a k X k = k = 1 n a k 2 Var [ X k ] + 2 i < j a i a j E [ X i X j ] - E [ X i ] E [ X j ]
    The term c i j = E [ X i X j ] - E [ X i ] E [ X j ] is the covariance of the pair { X i , X j } , whose role we study in the unit on that topic. If the c i j are all zero, we say the class is uncorrelated .

Questions & Answers

the diagram of the digestive system
Assiatu Reply
allimentary cannel
Ogenrwot
How does twins formed
William Reply
They formed in two ways first when one sperm and one egg are splited by mitosis or two sperm and two eggs join together
Oluwatobi
what is genetics
Josephine Reply
Genetics is the study of heredity
Misack
how does twins formed?
Misack
What is manual
Hassan Reply
discuss biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles
Joseph Reply
what is biology
Yousuf Reply
the study of living organisms and their interactions with one another and their environments
AI-Robot
the study of living organisms and their interactions with one another and their environment.
Wine
discuss the biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles in an essay form
Joseph Reply
what is the blood cells
Shaker Reply
list any five characteristics of the blood cells
Shaker
lack electricity and its more savely than electronic microscope because its naturally by using of light
Abdullahi Reply
advantage of electronic microscope is easily and clearly while disadvantage is dangerous because its electronic. advantage of light microscope is savely and naturally by sun while disadvantage is not easily,means its not sharp and not clear
Abdullahi
cell theory state that every organisms composed of one or more cell,cell is the basic unit of life
Abdullahi
is like gone fail us
DENG
cells is the basic structure and functions of all living things
Ramadan
What is classification
ISCONT Reply
is organisms that are similar into groups called tara
Yamosa
in what situation (s) would be the use of a scanning electron microscope be ideal and why?
Kenna Reply
A scanning electron microscope (SEM) is ideal for situations requiring high-resolution imaging of surfaces. It is commonly used in materials science, biology, and geology to examine the topography and composition of samples at a nanoscale level. SEM is particularly useful for studying fine details,
Hilary
cell is the building block of life.
Condoleezza Reply
what is cell divisoin?
Aron Reply
Diversity of living thing
ISCONT
what is cell division
Aron Reply
Cell division is the process by which a single cell divides into two or more daughter cells. It is a fundamental process in all living organisms and is essential for growth, development, and reproduction. Cell division can occur through either mitosis or meiosis.
AI-Robot
What is life?
Allison Reply
life is defined as any system capable of performing functions such as eating, metabolizing,excreting,breathing,moving,Growing,reproducing,and responding to external stimuli.
Mohamed
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now




Source:  OpenStax, Applied probability. OpenStax CNX. Aug 31, 2009 Download for free at http://cnx.org/content/col10708/1.6
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Applied probability' conversation and receive update notifications?

Ask