Statistics - Residual analysis

Residual analysis is used to assess the appropriateness of a pnear regression model by defining residuals and examining the residual plot graphs.

Residual

Residual($ e $) refers to the difference between observed value($ y $) vs predicted value ($ hat y $). Every data point have one residual.

Residual Plot

A residual plot is a graph in which residuals are on tthe vertical axis and the independent variable is on the horizontal axis. If the dots are randomly dispersed around the horizontal axis then a pnear regression model is appropriate for the data; otherwise, choose a non-pnear model.

Types of Residual Plot

Following example shows few patterns in residual plots.

In first case, dots are randomly dispersed. So pnear regression model is preferred. In Second and third case, dots are non-randomly dispersed and suggests that a non-pnear regression method is preferred.

Example

Problem Statement:

Check where a pnear regression model is appropriate for the following data.

Solution:

Step 1: Compute residuals for each data point.

Step 2: - Draw the residual plot graph.

Step 3: - Check the randomness of the residuals.

Here residual plot exibits a random pattern - First residual is positive, following two are negative, the fourth one is positive, and the last residual is negative. As pattern is quite random which indicates that a pnear regression model is appropriate for the above data.