9.1 Least squares, calculator work, correlation coefficients

Siyavula textbooks: grade 12 Page 1 / 2

The method of least squares

We now come to a more accurate method of finding the line of best-fit. The method is very simple. Suppose we guess a line of best-fit. Then at at every data point, we find the distance between the data point and the line. If the line fitted the data perfectly, this distance should be zero for all the data points. The worse the fit, the larger the differences. We then square each of these distances, and add them all together.

The best-fit line is then the line that minimises the sum of the squared distances.

Suppose we have a data set of $n$ points ${(x_{1}; y_{1}), (x_{2}; y_{2}), ..., (x_{n}, y_{n})}$ . We also have a line $f (x) = m x + c$ that we are trying to fit to the data. The distance between the first data point and the line, for example, is

distance = y_{1} - f (x) = y_{1} - (m x + c)

We now square each of these distances and add them together. Lets call this sum $S (m, c)$ . Then we have that

\begin{matrix} S (m, c) & = & {(y_{1} - f (x_{1}))}^{2} + {(y_{2} - f (x_{2}))}^{2} + ... + {(y_{n} - f (x_{n}))}^{2} \\ = & \sum_{i = 1}^{n} {(y_{i} - f (x_{i}))}^{2} \end{matrix}

Thus our problem is to find the value of $m$ and $c$ such that $S (m, c)$ is minimised. Let us call these minimising values $m_{0}$ and $c_{0}$ . Then the line of best-fit is $f (x) = m_{0} x + c_{0}$ . We can find $m_{0}$ and $c_{0}$ using calculus, but it is tricky, and we will just give you the result, which is that

\begin{matrix} m_{0} & = & \frac{n \sum_{i = 1}^{n} x_{i} y_{i} - \sum_{i = 1}^{n} x_{i} \sum_{i = 1}^{n} y_{i}}{n \sum_{i = 1}^{n} {(x_{i})}^{2} - {(\sum_{i = 1}^{n}, x_{i})}^{2}} \\ c_{0} & = & \frac{1}{n} \sum_{i = 1}^{n} y_{i} - \frac{m_{0}}{n} \sum_{i = 0}^{n} x_{i} = \bar{y} - m_{0} \bar{x} \end{matrix}

Khan academy video on regression - 1

In the table below, we have the records of the maintenance costs in Rands, compared with the age of the appliance in months. We have data for 5 appliances.

appliance	1	2	3	4	5
age ( $x$ )	5	10	15	20	30
cost ( $y$ )	90	140	250	300	380

Find the line of best fit using the method of least squares.

Draw up a table of

x

y

x y

and

x^{2}

values

appliance	$x$	$y$	$x y$	$x^{2}$
1	5	90	450	25
2	10	140	1400	100
3	15	250	3750	225
4	20	300	6000	400
5	30	380	11400	900
Total	80	1160	23000	1650

Work out $m_{0}$ and $c_{0}$ and write the equation
$\begin{matrix} m_{0} & = & \frac{n \sum x y - \sum x \sum y}{n \sum x^{2} - {(\sum x)}^{2}} = \frac{5 \times 23000 - 80 \times 1160}{5 \times 1650 - 80^{2}} = 12 \\ c_{0} & = & \bar{y} - b \bar{x} = \frac{1160}{5} - \frac{12 \times 80}{5} = 40 \\ ∴ & \underset{̲}{\hat{y} = 40 + 12 x} \end{matrix}$

Using a calculator

Find a regression equation for the following data:

Days ( $x$ )	1	2	3	4	5
Growth in m ( $y$ )	1,00	2,50	2,75	3,00	3,50

Getting your calculator ready
Using your calculator, change the mode from normal to “Stat $x y$ ”. This mode enables you to type in bivariate data.

Entering the data

Key in the data as follows:

1	$(x, y)$	1	DATA	$n$ = 1
2	$(x, y)$	2,5	DATA	$n$ = 2
3	$(x, y)$	2,75	DATA	$n$ = 3
4	$(x, y)$	3,0	DATA	$n$ = 4
5	$(x, y)$	3,5	DATA	$n$ = 5

Getting regression results from the calculator
Ask for the values of the regression coefficients $a$ and $b$ .

RCL $a$ gives $a =$ 0,9

RCL $b$ gives $b =$ 0,55

$∴ \hat{y} = 0, 9 + 0, 55 x$

Using a calculator determine the least squares line of best fit for the following data set of marks.

Learner	1	2	3	4	5
Chemistry (%)	52	55	86	71	45
Accounting (%)	48	64	95	79	50

For a Chemistry mark of 65%, what mark does the least squares line predict for Accounting?

Getting your calculator ready
Switch on the calculator. Press [MODE] and then select STAT by pressing [2]. The following screen will appear:

1 1-VAR 2 A + BX

3 $_$ + CX $^{2}$ 4 ln X

5 e $\hat{}$ X 6 A . B $\hat{}$ X

7 A . X $\hat{}$ B 8 1/X

Now press [2] for linear regression. Your screen should look something like this:

x y

1

2

3
Entering the data
Press [52] and then [=]to enter the first mark under $x$ . Then enter the other values, in the same way, for the $x$ -variable (the Chemistry marks) in the order in which they are given in the data set. Then move the cursor across and up and enter 48 under $y$ opposite 52 in the $x$ -column. Continue to enter the other $y$ -values (the Accounting marks) in order so that they pair off correctly with the corresponding $x$ -values.

x y

1 52

2 55

3

Then press [AC]. The screen clears but the data remains stored.

1: Type 2: Data

3: Edit 4: Sum

5: Var 6: MinMax

7: Reg

Now press [SHIFT][1]to get the stats computations screen shown below. Choose Regression by pressing [7].

1: A 2: B

3: r 4: $\hat{x}$

5: $\hat{y}$
Getting regression results from the calculator
1. a) Press [1] and [=]to get the value of the $y$ -intercept, $a = - 5, 065 . . = - 5, 07$ (to 2 d.p.) Finally, to get the slope, use the following key sequence: [SHIFT][1][7][2][=]. The calculator gives $b = 1, 169 . . = 1, 17$ (to 2 d.p.) The equation of the line of regression is thus: $\hat{y} = - 5, 07 + 1, 17 x$
2. b) Press [AC][65][SHIFT][1][7][5][=] This gives a (predicted) Accounting mark of $\hat{} = 70, 94 = 71$ %

Questions & Answers

what is biology

Hajah Reply

the study of living organisms and their interactions with one another and their environments

AI-Robot

what is biology

Victoria Reply

HOW CAN MAN ORGAN FUNCTION

Alfred Reply

the diagram of the digestive system

Assiatu Reply

allimentary cannel

Ogenrwot

How does twins formed

William Reply

They formed in two ways first when one sperm and one egg are splited by mitosis or two sperm and two eggs join together

Oluwatobi

what is genetics

Josephine Reply

Genetics is the study of heredity

Misack

how does twins formed?

Misack

What is manual

Hassan Reply

discuss biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles

Joseph Reply

what is biology

Yousuf Reply

the study of living organisms and their interactions with one another and their environment.

Wine

discuss the biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles in an essay form

Joseph Reply

what is the blood cells

Shaker Reply

list any five characteristics of the blood cells

Shaker

lack electricity and its more savely than electronic microscope because its naturally by using of light

Abdullahi Reply

advantage of electronic microscope is easily and clearly while disadvantage is dangerous because its electronic. advantage of light microscope is savely and naturally by sun while disadvantage is not easily,means its not sharp and not clear

Abdullahi

cell theory state that every organisms composed of one or more cell,cell is the basic unit of life

Abdullahi

is like gone fail us

DENG

cells is the basic structure and functions of all living things

Ramadan

What is classification

ISCONT Reply

is organisms that are similar into groups called tara

Yamosa

in what situation (s) would be the use of a scanning electron microscope be ideal and why?

Kenna Reply

A scanning electron microscope (SEM) is ideal for situations requiring high-resolution imaging of surfaces. It is commonly used in materials science, biology, and geology to examine the topography and composition of samples at a nanoscale level. SEM is particularly useful for studying fine details,

Hilary

cell is the building block of life.

Condoleezza Reply

Got questions? Join the online conversation and get instant answers!

Jobilize.com Reply

<< Chapter < Page Page > Chapter >>

Read also:

Get Jobilize Job Search Mobile App in your pocket Now!

100% Free Mobile Applications
Receive real-time job alerts and never miss the right job again

Source: OpenStax, Siyavula textbooks: grade 12 maths. OpenStax CNX. Aug 03, 2011 Download for free at http://cnx.org/content/col11242/1.2

Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Siyavula textbooks: grade 12 maths' conversation and receive update notifications?

Ask

	3 Physiotherapy Flashcards Set 3 By Rhodes Start Flashcards
©flickr: Luis	Chemistry Final Review By Madison Christian Start Exam
©flickr: Iqbal	Liver Cancer By Darlene Paliswat Start Test
	How well do you know 5SOS? By Wey Hey Start Quiz
	Professional makeup certification Test By Angela January Start Quiz
	5 Biology 05 Plasma Membranes Structure Function By OpenStax Start Quiz
	2 AP 02 Chemical Level of Organization Essay By OpenStax Start Flashcards
	6 Neuroanatomy 06 Head Somatic Visceral Sensory By Stephen Voron Start Quiz
	Fluid Mechanics MCQ By Stephanie Redfern Start Quiz
	Capitalism Market Economy By Robert Murphy Start Test

1	1-VAR	2	A + BX
3	$_$ + CX $^{2}$	4	ln X
5	e $\hat{}$ X	6	A . B $\hat{}$ X
7	A . X $\hat{}$ B	8	1/X

RCL	$a$	gives	$a =$ 0,9
RCL	$b$	gives	$b =$ 0,55

1:	Type	2:	Data
3:	Edit	4:	Sum
5:	Var	6:	MinMax
7:	Reg

1:	A	2:	B
3:	r	4:	$\hat{x}$
5:	$\hat{y}$