What Is ANOVA? How to Read and Run ANOVA in SPSS

Statistics··11 min read

What is ANOVA

You open your data file and want to know whether the mean scores of three or more groups differ. ANOVA, short for Analysis of Variance, is used to test differences between the means of three or more groups. For example, you might compare customer satisfaction across three age groups or compare purchase intention across four income groups.

ANOVA does not look only at the differences between means. It compares the variation between groups with the variation within each group. The ratio is usually expressed as the F statistic:

F = between-group variance / within-group variance

When the variation between groups is substantially larger than the variation within groups, F becomes large and the p-value may be small. You then have grounds to reject the hypothesis that the groups have the same mean. In SPSS, the most common type is One-Way ANOVA, used when you have one independent grouping variable and one quantitative variable to compare.

You can see the dedicated guide to One-Factor ANOVA if your model has only one grouping factor. The article on the ANOVA table is more suitable when you need to explain the Sum of Squares, df, Mean Square, F, and Sig. rows in the output separately.

The role of ANOVA in quantitative research

In a quantitative thesis, ANOVA answers a specific question: are the mean values of the dependent variable the same across the groups of the independent variable? The independent variable is usually categorical, such as gender, age group, education level, or region. The dependent variable is often the mean score of a scale, a rating score, or another quantitative index.

The null hypothesis, H0, states that the groups have the same population mean. The alternative hypothesis, H1, states that at least one pair of groups has different values. ANOVA tells you only that a difference exists somewhere between the groups. It does not immediately tell you which groups differ.

This is where many students stop too early. If the ANOVA p-value is small, you need to run Post Hoc Tests, usually Tukey or another option that matches the variance assumption, to identify the individual pairs that differ. If you write “group 1 differs from group 2” based only on the overall ANOVA table, the conclusion is not sufficiently supported.

ANOVA also helps you test a research hypothesis such as, “There is a difference in Y between the groups of X.” It does not test a linear relationship like regression, measure association like correlation, or replace the chi-square test when both variables are categorical. When your study needs to test the relationship between two categorical variables, see What is the Chi-square test.

What ANOVA value is acceptable

The phrase “what ANOVA value is good” often leads students to search for a cutoff for F. In practice, you do not judge ANOVA by whether F exceeds one fixed number. The main decision usually relies on the p-value, printed in the Sig. column of SPSS output. The significance level should be determined in advance based on the research design and the conventions of your study, with 0.05 being common.

The table below separates the indicators so you do not confuse applicability conditions with the test conclusion. Each threshold is shown with its corresponding canonical source.

What to checkThreshold or interpretationSource
Sig. of Levene's testIf Sig. is greater than 0.05, the equal-variance assumption has not been rejected(Field, 2013)
Sig. in the ANOVA tableIf Sig. is less than 0.05, reject H0 and conclude that the means differ between at least two groups(Field, 2013)
Durbin-Watson in the related regression modelA value between 1 and 3 is commonly considered suitable for checking residual autocorrelation(Field, 2013)
Sample size for regression with m predictorsn of 50 + 8m or more is a rule of thumb(Tabachnick and Fidell, 2013)
Pairwise tests after ANOVARead the p-value for each pair in the Multiple Comparisons table, rather than inferring it from the overall F(Field, 2013)

In the ANOVA table, Sig. < 0.05 is commonly interpreted as a statistically significant difference between the means of at least two groups. The phrase “at least two groups” matters because ANOVA does not identify the groups until you inspect the Post Hoc results.

If Sig. >= 0.05, you do not have enough statistical evidence to reject H0. A careful sentence is, “No statistically significant difference between the groups was recorded,” rather than claiming that the groups are completely identical.

A small p-value also does not tell you whether the difference is large in practical terms. You should also examine the mean and standard deviation for each group and the size of the difference. With very large groups, a small difference can still produce a small p-value.

How to read ANOVA output

In SPSS, One-Way ANOVA output usually contains the Descriptives, Test of Homogeneity of Variances, ANOVA, and, if selected, Multiple Comparisons tables. Read them in order. Do not jump straight to the Sig. column while ignoring the conditions for applying the test.

The following is illustrative output, not the result of a real study. Assume that the dependent variable is satisfaction score and the grouping variable consists of three age groups. The table is shortened in the way SPSS commonly displays it.

SPSS tableSource or GroupSum of SquaresdfMean SquareFSig.
ANOVABetween Groups18.42029.2105.1840.007
ANOVAWithin Groups154.330871.774
ANOVATotal172.75089

With this illustrative output, F = 5.184 and Sig. = 0.007. Because 0.007 is less than 0.05, the result shows that mean satisfaction differs between at least two of the three age groups. This result does not yet allow you to name the specific pair that differs.

Suppose the Test of Homogeneity of Variances table shows Levene Statistic = 1.263, df1 = 2, df2 = 87, and Sig. = 0.288. Because Sig. is greater than 0.05, the equal-variance assumption is considered suitable at this stage of the check. You can read the Post Hoc table using Tukey if the groups meet the relevant conditions.

For example, the Multiple Comparisons table might show the following illustrative output:

(I) Age group(J) Age groupMean Difference (I-J)Std. ErrorSig.95% Confidence Interval
18 to 2526 to 35-0.620.210.011-1.12 to -0.12
18 to 25Over 35-0.180.230.710-0.73 to 0.37
26 to 35Over 350.440.220.120-0.08 to 0.96

In this example, only the 18 to 25 and 26 to 35 pair has Sig. below 0.05. The negative sign of Mean Difference means that the mean for the 18 to 25 group is lower than the mean for the 26 to 35 group under the I minus J calculation. Check the Descriptives table as well so that you report the correct mean and standard deviation for each group.

What to do when ANOVA is not significant

If the ANOVA table has Sig. >= 0.05, first check whether you selected the correct variables and group codes. A data-entry error, such as coding “Male” as 1 in some rows and 3 in others, can make the result meaningless. Check Variable View, Value Labels, the number of observations, and the frequency table before running the analysis again.

If the result remains statistically non-significant after the data and model are correct, keep that result. Do not randomly remove a group, change the scale, or try multiple specifications until the p-value becomes small just to obtain a significant result. The committee may ask why a data-processing decision was not stated in the method section.

If ANOVA is significant but Levene's test indicates that the group variances are unequal, consider Welch ANOVA in SPSS. For Post Hoc analysis, Games-Howell may be suitable when it matches the variance pattern and sample sizes. State clearly which option you used and why.

If the data are strongly skewed, contain serious outliers, or have very unequal group sizes, inspect the charts, descriptive statistics, and original data record. Deleting an outlier simply because it changes the p-value is difficult to defend. Remove an observation only when you have a clear data-quality or measurement reason, and record the row that was removed.

With two groups, an independent-samples t test is often more suitable than One-Way ANOVA. You can see t test to distinguish cases involving two means, or read t test if you need to test a hypothesis and interpret the Sig. value in the Independent Samples Test table.

Distinguishing ANOVA from the t test

ANOVA and the t test can both compare means, but the number of groups and the research question differ. An independent-samples t test is usually used with two independent groups. One-Way ANOVA is used with three or more independent groups and one quantitative dependent variable.

You should not split a three-group problem into multiple pairwise t tests without controlling for repeated testing. Each test adds to the risk of a false-positive conclusion. ANOVA lets you test the overall difference first and then use Post Hoc analysis to identify the pairs that differ.

ANOVA also differs from MANOVA, ANCOVA, and regression. MANOVA handles multiple dependent variables at the same time. ANCOVA adds a covariate to the model. Regression focuses on how the dependent variable changes with a predictor, usually a continuous variable or a variable coded for the model.

If the outcome variable is categorical, do not force it into a mean score simply to run ANOVA. Identify the variable type, number of groups, independence of observations, and hypothesis objective before choosing the procedure.

Common errors

Looking only at F and ignoring Sig. A large or small F has no independent interpretation until you examine the p-value, degrees of freedom, and sample-size context. Read Sig. in the ANOVA table and compare it with the significance level you selected.

Concluding which groups differ from the overall ANOVA table. The ANOVA table shows only that at least one difference exists. To identify the pair, you must inspect Multiple Comparisons or an appropriate Post Hoc procedure.

Using ANOVA for two categorical variables. If both the grouping variable and the outcome variable are categorical, ANOVA is not the natural choice. If the question is whether two variables are associated, consider the Chi-square test.

Skipping assumption checks. You need to inspect group variances, outliers, and how the dependent variable was measured. When important assumptions are violated, consider Welch ANOVA or an alternative procedure supported by a clear reason.

Writing “ANOVA is acceptable” without reporting the numbers. A results paragraph should include the group mean or standard deviation, F, degrees of freedom, p-value, and a conclusion linked to the hypothesis. If you ran Post Hoc analysis, report the pair that differs and the direction of the difference.

How to write this in your thesis: “The One-Way ANOVA result shows a difference in [dependent variable name] between the groups of [grouping variable name], F([between df], [within df]) = [F], p = [p]. The Post Hoc analysis shows that [group A] has a [higher/lower] mean score than [group B], while [other pair] does not differ significantly.” Replace every bracketed section with the actual values from your output.

Frequently asked questions

What is ANOVA and when should you use it?

ANOVA is a test used to compare the means of three or more groups. Use One-Way ANOVA when you have one independent grouping variable and one quantitative dependent variable, such as satisfaction scores across three age groups.

If there are only two groups, an independent-samples t test is usually the more direct choice. If you have multiple dependent variables or a more complex design, review the model before selecting the procedure.

What ANOVA value is acceptable?

In the common interpretation, Sig. < 0.05 indicates a statistically significant difference between at least two groups. Sig. >= 0.05 means that there is not enough evidence to reject the hypothesis that the groups have the same mean.

There is no single fixed F value considered “good” for every study. F must be read together with the degrees of freedom, p-value, sample size, and descriptive statistics.

Where do you run ANOVA in SPSS?

Go to Analyze > Compare Means > One-Way ANOVA. Move the dependent variable into Dependent List and the grouping variable into Factor, then open Options and select Descriptive and Homogeneity of variance test. Under Post Hoc, select a suitable procedure if you need pairwise comparisons.

The menu names may differ slightly between SPSS versions, but the main tables are usually Descriptives, Test of Homogeneity of Variances, ANOVA, and Multiple Comparisons.

How should you write ANOVA with Sig. equal to 0.000?

Do not write p as exactly zero. SPSS displays 0.000 because the p-value is smaller than the display limit, so you can write p < 0.001 when the output is shown that way. Then state the conclusion in relation to the hypothesis and check the Post Hoc results to identify the pair that differs.

What should you do when Levene Sig. is below 0.05?

This result indicates that the equal-variance assumption may be violated. You can inspect the Welch row in the Robust Tests of Equality of Means table and select a Post Hoc procedure such as Games-Howell when it suits the data.

State the treatment clearly in your thesis instead of using the standard ANOVA table without explanation. If the violation occurs together with outliers or highly unequal group sizes, check the original data before deciding what to do.

Open your SPSS file, identify the grouping variable and dependent variable, run Analyze > Compare Means > One-Way ANOVA, and save the four output tables together with the descriptive statistics before writing the conclusion. If you need to run the analysis on your own .sav or .csv file, you can use DoThesis M4 analysis.