The Pearson Product-Moment Correlation Coefficient (r), or correlation coefficient for short is a measure of the degree of linear relationship between two variables. usually labeled X and Y. While in regression the emphasis is on predicting one variable from the other, in correlation the emphasis is on the degree to which a linear model may describe the relationship between two variables. In regression the interest is directional, one variable is predicted and the other is the predictor; in correlation the interest is non-directional, the relationship is the critical aspect.
The correlation coefficient may take on any value between plus and minus one.
The sign of the correlation coefficient (+. -) defines the direction of the relationship, either positive or negative. A positive correlation coefficient means that as the value of one variable increases, the value of the other variable increases; as one decreases the other decreases. A negative correlation coefficient indicates that as one variable increases, the other decreases, and vice-versa.
Remember that correlation does not mean causation. One can not draw cause and effect conclusions based on correlation.
There are two reasons why we can not make causal statements:
- We don't know the direction of the cause - Does X cause Y or does Y cause X?
- A third variable "Z" may be involved that is responsible for the covariance between X and Y
Taking the absolute value of the correlation coefficient measures the strength of the relationship. A correlation coefficient of r=.50 indicates a stronger degree of linear relationship than one of r=.40. Likewise a correlation coefficient of r=-.50 shows a greater degree of relationship than one of r=.40. Thus a correlation coefficient of zero (r=0.0) indicates the absence of a linear relationship and correlation coefficients of r=+1.0 and r=-1.0 indicate a perfect linear relationship.
UNDERSTANDING AND INTERPRETING THE CORRELATION COEFFICIENT
The correlation coefficient may be understood by various means, each of which will now be examined in turn.
We can graph the data used in computing a correlation coefficient. Essentially, with the Pearson Product
Moment Correlation, we are examining the relationship between two variables - X and Y. By plotting each data pair (you will have sets of scores for X and Y), you will have created a graph call a scatterplot or scatterdiagram. Thus, if you were graphing height and weight for all of the children in a first grade class with twenty students, you would place a single dot on the graph at the point where each student's height and weight intersect. For correlation, it does not make any difference which variable goes on the x-axis and which variable goes on the y-axis. However, for linear regression, the variable that is the predictor goes on the x-axis. The variable being predicted goes on the y-axis.
To evaluate the degree of relationship, one looks at both the slope of the line that would best fit through the data points as well as the degree of scatter from that same line. In correlation, we do not draw the line; in linear regression, we compute the position of the line. The more dispersed the data points, the lower the correlation. The closer all of the data points are to the line, in other words the less scatter, the higher the degree of correlation.
The scatterplots presented below perhaps best illustrate how the correlation coefficient changes as the linear relationship between the two variables is altered. When r=0.0 the points scatter widely about the plot, the majority falling roughly in the shape of a circle. As the linear relationship increases, the circle becomes more and more elliptical in shape until the limiting case is reached (r=1.00 or r=-1.00) and all the points fall on a straight line.
A number of scatterplots and their associated correlation coefficients are presented below in order that the student may better estimate the value of the correlation coefficient based on a scatterplot in the associated computer exercise.
When examining the scatterplots below, examine both the size (degree of the relationship) as well as sign (positive or negative correlation).
r = 1.00
r = -.54
r = .85