Sign In

1.19 : Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this experiment 100 times, we would expect to find the same results at least 95 times out of 100.

The greatest strength of experiments is the ability to assert that any significant differences in the findings are caused by the independent variable. This occurs because random selection, random assignment, and a design that limits the effects of both experimenter bias and participant expectancy should create groups that are similar in composition and treatment. Therefore, any difference between the groups is attributable to the independent variable, and now we can finally make a causal statement. If we find that watching a violent television program results in more violent behavior than watching a nonviolent program, we can safely say that watching violent television programs causes an increase in the display of violent behavior.

Tags
Statistical SignificanceEmpirical DataSample SizeStatistical AnalysesDifferences Between Groups Or VariablesMeaningful DifferencesChance AloneExperimental GroupControl GroupP valueProbabilityChance OccurrenceStatistically SignificantExperimental ManipulationAlternative Hypothesis

From Chapter 1:

article

Now Playing

1.19 : Statistical Significance

Research Methods

16.7K Views

article

1.1 : The Scientific Method

Research Methods

56.4K Views

article

1.2 : Case Studies

Research Methods

11.1K Views

article

1.3 : Naturalistic Observations

Research Methods

14.9K Views

article

1.4 : Surveys

Research Methods

14.3K Views

article

1.5 : Archival Research

Research Methods

15.6K Views

article

1.6 : Longitudinal Research

Research Methods

11.5K Views

article

1.7 : Cross-Sectional Research

Research Methods

10.9K Views

article

1.8 : Group Design

Research Methods

8.4K Views

article

1.9 : Factorial Design

Research Methods

9.7K Views

article

1.10 : The Placebo Effect

Research Methods

5.9K Views

article

1.11 : Blind Procedures

Research Methods

10.3K Views

article

1.12 : Ethics in Research

Research Methods

22.5K Views

article

1.13 : Correlations

Research Methods

29.8K Views

article

1.14 : Cause and Effect

Research Methods

10.5K Views

See More

JoVE Logo

Privacy

Terms of Use

Policies

Research

Education

ABOUT JoVE

Copyright © 2025 MyJoVE Corporation. All rights reserved