Reliability in Psychology Experiments

Обзор

Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco—Monmouth University

In order to study something scientifically, a researcher needs to determine a way to quantify it. However, psychological constructs can be challenging to measure and quantify. This video examines reliability in the context of content analysis. 

A recent study in the journal Pediatrics reported that 4-year-olds who watched a fast-paced cartoon had worse performance on cognitive tasks, such as following rules in a game, listening to direction from an adult, and delaying gratification, compared to other children who watched a slower paced cartoon.1 In addition to the pace of the cartoon, the content of the cartoon may also have deleterious effects on its young viewers.

This video uses a simple two-group design, to exemplify the issue of reliability, in examining the question of whether the cartoon SpongeBob SquarePants has more inappropriate content than does the cartoon Caillou.

Процедура

1. Define key variables.

  1. Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of inappropriate content.
  2. Consult definitions created by the organization TV Parental Guidelines and approved by the Federal Communications Commission.
  3. Inappropriate content is any crude or rude behavior (e.g., toilet humor), depictions of verbal or physical aggression (e.g., name calling, hitting, etc.), bad language (

    Log in or to access full content. Learn more about your institution’s access to JoVE content here

Результаты

The results indicate that the raters had a high level of agreement or consistency in their ratings within each cartoon episode, which indicates high inter-rater reliability (Figure 1). There is also reliability or consistency in SpongeBob SquarePants episodes having more inappropriate content than Caillou. The results also revealed individual biases amongst raters. For example, Rater 3 reported more inappropriate content in SpongeBob than the other 2 raters, and Rater 1 reported less in Caillou than othe

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Заявка и Краткое содержание

Researchers have increasingly turned their attention toward analyzing television’s content, especially as it relates to children. As discussed prior to this current experiment, a recent study in the journal Pediatrics correlated the fast pace of the SpongeBob SquarePants cartoon to relatively poor cognitive abilities in the children who watch it.

Since the results of our experiment appear reliable, future research could examine whether the relative amount of inappropriate conten

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Ссылки
  1. Lillard, A. S., & Peterson, J. The Immediate Impact of Different Types of Television on Young Children's Executive Function. Pediatrics. 128(4):644-9. doi: 10.1542/peds.2010-1919 (2011).
Теги
ReliabilityPsychology ExperimentsMeasurementsVariabilityInter rater ReliabilityInappropriate BehaviorsCartoonsWithin subjects DesignDependent VariableCrude And Rude BehaviorsBad LanguageVerbal AggressionPhysical AggressionReferences To DrugsSexual Content

Перейти к...

0:00

Overview

0:57

Experimental Design

2:09

Running the Experiment

2:58

Representative Results

3:47

Applications

4:44

Summary

Видео из этой коллекции:

article

Now Playing

Reliability in Psychology Experiments

Experimental Psychology

8.4K Просмотры

article

From Theory to Design: The Role of Creativity in Designing Experiments

Experimental Psychology

17.9K Просмотры

article

Ethics in Psychology Research

Experimental Psychology

28.9K Просмотры

article

Realism in Experimentation

Experimental Psychology

8.2K Просмотры

article

Perspectives on Experimental Psychology

Experimental Psychology

5.6K Просмотры

article

Pilot Testing

Experimental Psychology

10.3K Просмотры

article

Observational Research

Experimental Psychology

12.8K Просмотры

article

The Simple Experiment: Two-group Design

Experimental Psychology

69.8K Просмотры

article

The Multi-group Experiment

Experimental Psychology

22.6K Просмотры

article

Within-subjects Repeated-measures Design

Experimental Psychology

22.8K Просмотры

article

The Factorial Experiment

Experimental Psychology

72.9K Просмотры

article

Self-report vs. Behavioral Measures of Recycling

Experimental Psychology

11.7K Просмотры

article

Placebos in Research

Experimental Psychology

11.5K Просмотры

article

Manipulating an Independent Variable through Embodiment

Experimental Psychology

8.5K Просмотры

article

Experimentation using a Confederate

Experimental Psychology

17.7K Просмотры

JoVE Logo

Исследования

Образование

О JoVE

Авторские права © 2025 MyJoVE Corporation. Все права защищены