Decoding Auditory Imagery with Multivoxel Pattern Analysis

Visión general

Source: Laboratories of Jonas T. Kaplan and Sarah I. Gimbel—University of Southern California

Imagine the sound of a bell ringing. What is happening in the brain when we conjure up a sound like this in the "mind's ear?" There is growing evidence that the brain uses the same mechanisms for imagination that it uses for perception.1 For example, when imagining visual images, the visual cortex becomes activated, and when imagining sounds, the auditory cortex is engaged. However, to what extent are these activations of sensory cortices specific to the content of our imaginations?

One technique that can help to answer this question is multivoxel pattern analysis (MPVA), in which functional brain images are analyzed using machine-learning techniques.2-3 In an MPVA experiment, we train a machine-learning algorithm to distinguish among the various patterns of activity evoked by different stimuli. For example, we might ask if imagining the sound of a bell produces different patterns of activity in auditory cortex compared with imagining the sound of a chainsaw, or the sound of a violin. If our classifier learns to tell apart the brain activity patterns produced by these three stimuli, then we can conclude that the auditory cortex is activated in a distinct way by each stimulus. One way to think of this kind of experiment is that instead of asking a question simply about the activity of a brain region, we ask a question about the information content of that region.

In this experiment, based on Meyer et al., 2010,4 we will cue participants to imagine several sounds by presenting them with silent videos that are likely to evoke auditory imagery. Since we are interested in measuring the subtle patterns evoked by imagination in auditory cortex, it is preferable if the stimuli are presented in complete silence, without interference from the loud noises made by the fMRI scanner. To achieve this, we will use a special kind of functional MRI sequence known as sparse temporal sampling. In this approach, a single fMRI volume is acquired 4-5 s after each stimulus, timed to capture the peak of the hemodynamic response.

Procedimiento

1. Participant recruitment

  1. Recruit 20 participants.
    1. Participants should be right-handed and have no history of neurological or psychological disorders.
    2. Participants should have normal or corrected-to-normal vision to ensure that they will be able to see the visual cues properly.
    3. Participants should not have metal in their body. This is an important safety requirement due to the high magnetic field involved in fMRI.
    4. Participants should not suffer from claustrophobia

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Resultados

The average classifier accuracy in the planum temporale across all 20 participants was 59%. According to the Wilcoxon Signed-Rank test, this is significantly different from chance level of 33%. The mean performance in the frontal pole mask was 32.5%, which is not greater than chance (Figure 2).

Figure 2
Figure 2. Classification perf

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Aplicación y resumen

MVPA is a useful tool for understanding how the brain represents information. Instead of considering the time-course of each voxel separately as in a traditional activation analysis, this technique considers patterns across many voxels at once, offering increased sensitivity compared with univariate techniques. Often a multivariate analysis uncovers differences where a univariate technique is not able to. In this case, we learned something about the mechanisms of mental imagery by probing the information content in a spe

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Referencias
  1. Kosslyn, S.M., Ganis, G. & Thompson, W.L. Neural foundations of imagery. Nat Rev Neurosci 2, 635-642 (2001).
  2. Haynes, J.D. & Rees, G. Decoding mental states from brain activity in humans. Nat Rev Neurosci 7, 523-534 (2006).
  3. Norman, K.A., Polyn, S.M., Detre, G.J. & Haxby, J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10, 424-430 (2006).
  4. Meyer, K., et al. Predicting visual stimuli on the basis of activity in auditory cortices. Nat Neurosci 13, 667-668 (2010).
Tags
Auditory ImageryMultivoxel Pattern AnalysisPerceptionBrain ActivationFunctional Magnetic Resonance Imaging fMRISilent VideosAcoustic StimuliDistinguishing SoundsAuditory CortexImaginationMemoryDetailed ProcessingFMRI SessionsNeural Patterns

Saltar a...

0:00

Overview

1:30

Experimental Design

4:40

Running the Experiment

6:37

Data Analysis

7:54

Representative Results

9:50

Applications

11:14

Summary

Vídeos de esta colección:

article

Now Playing

Decoding Auditory Imagery with Multivoxel Pattern Analysis

Neuropsychology

6.4K Vistas

article

El cerebro dividido

Neuropsychology

68.1K Vistas

article

Mapas de motor

Neuropsychology

27.4K Vistas

article

Perspectivas de la neuropsicología

Neuropsychology

12.0K Vistas

article

Toma de decisiones y la Iowa Gambling Task

Neuropsychology

32.1K Vistas

article

Función ejecutiva en el trastorno del espectro autista

Neuropsychology

17.5K Vistas

article

Amnesia Anterógrada

Neuropsychology

30.2K Vistas

article

Correlatos fisiológicos de reconocimiento de la emoción

Neuropsychology

16.2K Vistas

article

Potenciales acontecimiento-relacionados y la tarea de Oddball

Neuropsychology

27.4K Vistas

article

Idioma: La N400 en incongruencia semántica

Neuropsychology

19.5K Vistas

article

Aprendizaje y la memoria: la tarea de recordar-sabe

Neuropsychology

17.1K Vistas

article

Medición de las diferencias de materia gris con Morfometría basada en Voxel: el cerebro Musical

Neuropsychology

17.2K Vistas

article

Atención visual: fMRI Control atencional basado en la investigación del objeto

Neuropsychology

40.7K Vistas

article

Utilizando imágenes de Tensor de difusión en la lesión cerebral traumática

Neuropsychology

16.7K Vistas

article

Uso de TMS para medir la excitabilidad motora durante la observación de la acción

Neuropsychology

10.1K Vistas

JoVE Logo

Privacidad

Condiciones de uso

Políticas

Investigación

Educación

ACERCA DE JoVE

Copyright © 2025 MyJoVE Corporation. Todos los derechos reservados