Linear regression is the next step up after correlation. It is used when we want to predict the value of a variable based on the value of another variable. The variable we want to predict is called the dependent variable (or sometimes, the outcome variable). The variable we are using to predict the other variable's value is called the independent variable (or sometimes, the predictor variable). For example, you could use linear regression to understand whether exam performance can be predicted based on revision time; whether cigarette consumptions can be predicted based on smoking duration; and so forth. If you have two or more independent variables, rather than just one, you need to use multiple regression.
This "quick start" guide shows you how to carry out linear regression using SPSS, as well as interpret and report the results from this test. However, before we introduce you to this procedure, you need to understand the different assumptions that your data must meet in order for linear regression to give you a valid result. We discuss these assumptions next.
When you choose to analyse your data using linear regression, part of the process involves checking to make sure that the data you want to analyse can actually be analysed using linear regression. You need to do this because it is only appropriate to use linear regression if your data "passes" six assumptions that are required for linear regression to give you a valid result. In practice, checking for these six assumptions just adds a little bit more time to your analysis, requiring you to click a few more buttons in SPSS when performing your analysis, as well as think a little bit more about your data, but it is not a difficult task.
Before we introduce you to these six assumptions, do not be surprised if, when analysing your own data using SPSS, one or more of these assumptions is violated (i.e., not met). This is not uncommon when working with real-world data rather than textbook examples, which often only show you how to carry out linear regression when everything goes well! However, don’t worry. Even when your data fails certain assumptions, there is often a solution to overcome this. First, let’s take a look at these six assumptions:
You can check assumptions #2, #3, #4, #5 and #6 using SPSS. Assumptions #2 and #3 should be checked first, before moving onto assumptions #4, #5 and #6. We suggest testing these assumptions in this order because it represents an order where, if a violation to the assumption is not correctable, you will no longer be able to use a single linear regression (although you may be able to run another statistical test on your data instead). Also, you check assumptions #4, #5 and #6 at the same time as running the linear regression procedure in SPSS, so it is easier to deal with these after checking assumptions #2 and #3. Just remember that if you do not run the statistical tests on these assumptions correctly, the results you get when running a linear regression might not be valid. This is why we dedicate a number of sections of our enhanced a linear regression guide to help you get this right. You can find out about our enhanced content as a whole here, or more specifically, learn how we help with testing assumptions here.
In the section, Procedure, we illustrate the SPSS procedure to perform a linear regression assuming that no assumptions have been violated. First, we introduce the example that is used in this guide.
A salesperson for a large car brand wants to determine whether there is a relationship between an individual's income and the price they pay for a car. Therefore, the individual’s "income" is the independent (predictor) variable and the "price" they pay for a car is the dependent (outcome) variable. The salesperson wants to use this information to determine which cars to offer potential customers in new areas where average income is known.
In SPSS, we created two variables so that we could enter our data: Income (the independent/predictor) variable, and Price (the dependent/outcome variable). It can also be useful to create a third variable, caseno, to act as a chronological case number. This third variable is used to make it easy for you to eliminate cases (e.g., significant outliers) that you have identified when checking for assumptions. However, we do not include it in the SPSS procedure that follows because we assume that you have already checked these assumptions. In our enhanced linear regression guide, we show you how to correctly enter data in SPSS to run a linear regression when you are also checking for assumptions. You can learn about our enhanced data setup content here. Alternately, we have a generic, "quick start" guide to show you how to enter data into SPSS, available here.
The five steps below show you how to analyse your data using linear regression in SPSS when none of the six assumptions in the previous section, Assumptions, have been violated. At the end of these five steps, we show you how to interpret the results from your linear regression. If you are looking for help to make sure your data meets assumptions #2, #3, #4, #5 and #6, which are required when using linear regression, and can be tested using SPSS, you can learn more in our enhanced guide here.
Click Analyze > Regression > Linear... on the top menu.
Published with written permission from SPSS Inc., an IBM Company.
You will be presented with the following dialog box:
Published with written permission from SPSS Inc., an IBM Company.
Transfer the independent (predictor) variable, Income, into the Independent(s): box and the dependent (outcome) variable, Price, into the Dependent: box. You can do this by either drag-and-dropping or by using the buttons.
Published with written permission from SPSS Inc., an IBM Company.
You now need to check four of the assumptions discussed in the Assumptions section above: No significant outliers (assumption #3); independence of observations (assumption #4); homoscedasticity (assumption #5); and normal distribution of errors/residuals (assumptions #6). You can do this by using the and features, and then selecting the appropriate tick boxes within these two dialogue boxes. In our enhanced linear regression guide, we show you which options to select in order to test whether your data meets these four assumptions.
SPSS will generate quite a few tables of output for a linear regression. In this section, we show you only the three main tables required to understand your results from the linear regression procedure, assuming that no assumptions have been violated. A complete explanation of the output you have to interpret when checking your data for the six assumptions required to carry out linear regression is provided in our enhanced guide here. This includes relevant scatterplots, histogram (with superimposed normal curve) and Normal P-P Plot, and casewise diagnostics and Durbin-Watson statistic tables. Below, we focus on the results for the linear regression analysis only.
The first table of interest is the Model Summary table. This table provides the R and R^{2} value. The R value is 0.873, which represents the simple correlation. It indicates a high degree of correlation. The R^{2} value indicates how much of the dependent variable, "price", can be explained by the independent variable, "income". In this case, 76.2% can be explained, which is very large.
Published with written permission from SPSS Inc., an IBM Company.
The next table is the ANOVA table. This table indicates that the regression model predicts the outcome variable significantly well. How do we know this? Look at the "Regression" row and go to the Sig. column. This indicates the statistical significance of the regression model that was applied. Here, p < 0.0005, which is less than 0.05, and indicates that, overall, the model applied can statistically significantly predict the outcome variable.
Published with written permission from SPSS Inc., an IBM Company.
The table below, Coefficients, provides us with information on each predictor variable. This gives us the information we need to predict price from income. We can see that both the constant and income contribute significantly to the model (by looking at the Sig. column). By looking at the B column under the Unstandardized Coefficients column, we can present the regression equation as:
Price = 8287 + 0.564(Income)
Published with written permission from SPSS Inc., an IBM Company.
If you are unsure how to interpret regression equations, or how to use them to make predictions, we discussed this in our enhanced linear regression guide. We also show you how to write up the results from your assumptions tests and linear regression output if you need to report this in a dissertation/thesis, assignment or research report. We do this using the Harvard and APA styles. You can learn more about our enhanced content here.
We also show you how to perform a linear regression analysis in SPSS here.