<< Chapter < Page Chapter >> Page >
This module provides an overview of Linear Regression and Correlation: The Correlation Coefficient and Coefficient of Determination. It is part of the Roberta Bloom's Custom Collection of Collaborative Statistics (col10617). It is based on module m17092 as a part of Collaborative Statistics collection (col10522) by Barbara Illowsky and Susan Dean. This revised has been expanded from the original to include coverage of the coefficient of determination and to include a discussion of properties of the correlation coefficient previously included in Illowsky and Dean's module. Some material previously in module m17077 Facts about the Correlation Coefficient have been moved to this module in Bloom's custom edition of Collaborative Statistics.

The correlation coefficient r

Besides looking at the scatter plot and seeing that a line seems reasonable, how can you tell if the line is a good predictor? Use the correlation coefficient as another indicator(besides the scatterplot) of the strength of the relationship between x and y .

The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is a numerical measure of the strength of association between the independent variable x and the dependent variable y.

The correlation coefficient is calculated as r = n Σ x y - ( Σ x ) ( Σ y ) [ n Σ x 2 - ( Σ x ) 2 ] [ n Σ y 2 - ( Σ y ) 2 ]

where n = the number of data points.

If you suspect a linear relationship between x and y , then r can measure how strong the linear relationship is.

    What the value of r tells us:

  • The value of r is always between -1 and +1: -1 r 1 .
  • The closer the correlation coefficient r is to -1 or 1 (and the further from 0), the stronger the evidence of a significant linear relationship between x and y ; this would indicate that the observed data points fit more closely to the best fit line. Values of r further from 0 indicate a stronger linear relationship between x and y . Values of r closer to 0 indicate a weaker linear relationship between x and y .
  • If r=0 there is absolutely no linear relationship between x and y (no linear correlation) .
  • If r = 1 , there is perfect positive correlation. If r = -1 , there is perfect negative correlation. In both these cases, all of the original data points lie on a straight line. Of course,in the real world, this will not generally happen.

    What the sign of r tells us

  • A positive value of r means that when x increases, y increases and when x decreases, y decreases (positive correlation) .
  • A negative value of r means that when x increases, y decreases and when x decreases, y increases (negative correlation) .
  • The sign of r is the same as the sign of the slope, b , of the best fit line.
Strong correlation does not suggest that x causes y or y causes x . We say "correlation does not imply causation." For example, every person who learned math in the 17th century is dead. However, learning math does not necessarily causedeath!

Positive correlation

Scatterplot of points ascending from the lower left to the upper right.
A scatter plot showing data with a positive correlation. 0 r 1

Negative correlation

Scatterplot of points descending from the upper left to the lower right.
A scatter plot showing data with a negative correlation. -1 r 0

Zero correlation

Scatterplot of points in a horizontal configuration.
A scatter plot showing data with zero correlation. r =0

The formula for r looks formidable. However, computer spreadsheets, statistical software, and many calculators can quickly calculate r . The correlation coefficient r is the bottom item in the output screens for the LinRegTTest on the TI-83, TI-83+, or TI-84+ calculator (see previous section for instructions).

The coefficient of determination

r 2 is called the coefficient of determination. r 2 is the square of the correlation coefficient , but is usually stated as a percent, rather than in decimal form. r 2 has an interpretation in the context of the data

  • r 2 , when expressed as a percent, represents the percent of variation in the dependent variable y that can be explained by variation in the independent variable x using the regression (best fit) line.
  • 1- r 2 , when expressed as a percent, represents the percent of variation in y that is NOT explained by variation in x using the regression line. This can be seen as the scattering of the observed data points about the regression line.

    Consider the third exam/final exam example Introduced in the previous section

  • The line of best fit is: y ^ = -173.51 + 4.83x
  • The correlation coefficient is r = 0.6631
  • The coefficient of determination is r 2 = 0.6631 2 = 0.4397
  • Interpretation of r 2 in the context of this example:
  • Approximately 44% of the variation in the final exam grades can be explained by the variation in the grades on the third exam, using the best fit regression line.
  • Therefore approximately 56% of the variation in the final exam grades can NOT be explained by the variation in the grades on the third exam, using the best fit regression line. (This is seen as the scattering of the points about the line.)

In the next section, we will learn more about the correlation coefficient and will examine r in the context of the example about grades on the third exam and final exam.

Questions & Answers

the diagram of the digestive system
Assiatu Reply
How does twins formed
William Reply
They formed in two ways first when one sperm and one egg are splited by mitosis or two sperm and two eggs join together
Oluwatobi
what is genetics
Josephine Reply
Genetics is the study of heredity
Misack
how does twins formed?
Misack
What is manual
Hassan Reply
discuss biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles
Joseph Reply
what is biology
Yousuf Reply
the study of living organisms and their interactions with one another and their environments
AI-Robot
the study of living organisms and their interactions with one another and their environment.
Wine
discuss the biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles in an essay form
Joseph Reply
what is the blood cells
Shaker Reply
list any five characteristics of the blood cells
Shaker
lack electricity and its more savely than electronic microscope because its naturally by using of light
Abdullahi Reply
advantage of electronic microscope is easily and clearly while disadvantage is dangerous because its electronic. advantage of light microscope is savely and naturally by sun while disadvantage is not easily,means its not sharp and not clear
Abdullahi
cell theory state that every organisms composed of one or more cell,cell is the basic unit of life
Abdullahi
is like gone fail us
DENG
cells is the basic structure and functions of all living things
Ramadan
What is classification
ISCONT Reply
is organisms that are similar into groups called tara
Yamosa
in what situation (s) would be the use of a scanning electron microscope be ideal and why?
Kenna Reply
A scanning electron microscope (SEM) is ideal for situations requiring high-resolution imaging of surfaces. It is commonly used in materials science, biology, and geology to examine the topography and composition of samples at a nanoscale level. SEM is particularly useful for studying fine details,
Hilary
cell is the building block of life.
Condoleezza Reply
what is cell divisoin?
Aron Reply
Diversity of living thing
ISCONT
what is cell division
Aron Reply
Cell division is the process by which a single cell divides into two or more daughter cells. It is a fundamental process in all living organisms and is essential for growth, development, and reproduction. Cell division can occur through either mitosis or meiosis.
AI-Robot
What is life?
Allison Reply
life is defined as any system capable of performing functions such as eating, metabolizing,excreting,breathing,moving,Growing,reproducing,and responding to external stimuli.
Mohamed
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply
Practice Key Terms 1

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now




Source:  OpenStax, Collaborative statistics: custom version modified by v moyle. OpenStax CNX. Nov 14, 2010 Download for free at http://legacy.cnx.org/content/col11238/1.2
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Collaborative statistics: custom version modified by v moyle' conversation and receive update notifications?

Ask