Name: interaction between phonological and semantic processes in visual word recognition using electrophysiology
Uploaded: 2021-06-29T14:00:00
Description: Watch this Scientific Journal Video about Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology at JoVE.com

This work was supported by Major Program of the National Natural Science Foundation of China (62036001).

The protocol used for this study was approved by the Institutional Review Board of Tsinghua University.
1. Stimuli construction and presentation
<ol>
	<li>Stimuli construction
	<ol>
		<li>Stimuli preparation: Prepare target words containing approximately 140 Chinese two-character compounds, of which low- and high-frequency words account for half. Precede each target by three analogues: a phonologically identical word (homonymous word), a word with related meaning, and an irrelevant control w...

<ol>
	<li>Carreiras, M., Armstrong, B. C., Perea, M., Frost, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+what,+when,+where,+and+how+of+visual+word+recognition.">The what, when, where, and how of visual word recognition.</a> Trends in Cognitive Sciences. 18 (2), 90-98 (2014).</li><li>Grainger, J., Kiyonaga, K., Holcomb, P. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+time+course+of+orthographic+and+phonological+code+activation.">The time course of orthographic and phonological code activation.</a> Psychological Science. 17 (12), 1021-1026 (2006).</li><li>Ashby, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phonology+is+fundamental+in+skilled+reading:+Evidence+from+ERPs.">Phonology is fundamental in skilled reading: Evidence from ERPs.</a> Psychonomic Bulletin Review. 17 (1), 95-100 (2010).</li><li>Wilson, L. B., Tregellas, J. R., Slason, E., Pasko, B. E., Rojas, D. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Implicit+phonological+priming+during+visual+word+recognition.">Implicit phonological priming during visual word recognition.</a> Neuroimage. 55 (2), 724-731 (2011).</li><li>Frost, R., Ahissar, M., Gotesman, R., Tayeb, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Are+phonological+effects+fragile?+The+effect+of+luminance+and+exposure+duration+on+form+priming+and+phonological+priming.">Are phonological effects fragile? The effect of luminance and exposure duration on form priming and phonological priming.</a> Journal of Memory and Language. 48 (2), 346-378 (2003).</li><li>Ferrand, L., Grainger, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effects+of+orthography+are+independent+of+phonology+in+masked+form+priming.">Effects of orthography are independent of phonology in masked form priming.</a> The Quarterly Journal of Experimental Psychology. 47 (2), 365-382 (1994).</li><li>Carreiras, M., Perea, M., Vergara, M., Pollatsek, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+time+course+of+orthography+and+phonology:+ERP+correlates+of+masked+priming+effects+in+Spanish.">The time course of orthography and phonology: ERP correlates of masked priming effects in Spanish.</a> Psychophysiology. 46 (5), 1113-1122 (2009).</li><li>Pattamadilok, C., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automaticity+of+phonological+and+semantic+processing+during+visual+word+recognition.">Automaticity of phonological and semantic processing during visual word recognition.</a> Neuroimage. 149, 244-255 (2017).</li><li>Harm, M. W., Seidenberg, M. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Computing+the+meanings+of+words+in+reading:+Cooperative+division+of+labor+between+visual+and+phonological+processes.">Computing the meanings of words in reading: Cooperative division of labor between visual and phonological processes.</a> Psychological Review. 111 (3), 662-720 (2004).</li><li>Brown, M. S., Roberts, M. A., Besner, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Semantic+processing+in+visual+word+recognition:+Activation+blocking+and+domain+specificity.">Semantic processing in visual word recognition: Activation blocking and domain specificity.</a> Psychonomic Bulletin &amp; Review. 8 (4), 778-784 (2001).</li><li>Devlin, J. T., Matthews, P. M., Rushworth, M. F. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Semantic+processing+in+the+left+inferior+prefrontal+cortex:+A+combined+functional+magnetic+resonance+imaging+and+transcranial+magnetic+stimulation+study.">Semantic processing in the left inferior prefrontal cortex: A combined functional magnetic resonance imaging and transcranial magnetic stimulation study.</a> Journal of Cognitive Neuroscience. 15 (1), 71-84 (2003).</li><li>Rodd, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=When+do+leotards+get+their+spots?+Semantic+activation+of+lexical+neighbors+in+visual+word+recognition.">When do leotards get their spots? Semantic activation of lexical neighbors in visual word recognition.</a> Psychonomic Bulletin &amp; Review. 11 (3), 434-439 (2004).</li><li>Frost, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Toward+a+strong+phonological+theory+of+visual+word+recognition:+True+issues+and+false+trails.">Toward a strong phonological theory of visual word recognition: True issues and false trails.</a> Psychological Bulletin. 123 (1), 71-99 (1998).</li><li>Yu, L., Reichle, E. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Chinese+versus+English:+Insights+on+cognition+during+reading.">Chinese versus English: Insights on cognition during reading.</a> Trends in Cognitive Sciences. 21 (10), 721-724 (2017).</li><li>Tan, L. H., Perfetti, C. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phonological+activation+in+visual+identification+of+Chinese+two-character+words.">Phonological activation in visual identification of Chinese two-character words.</a> Journal of Experimental Psychology: Learning, Memory, and Cognition. 25 (2), 382 (1999).</li><li>Liu, Y., Perfetti, C. A., Hart, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=ERP+evidence+for+the+time+course+of+graphic,+phonological,+and+semantic+information+in+Chinese+meaning+and+pronunciation+decisions.">ERP evidence for the time course of graphic, phonological, and semantic information in Chinese meaning and pronunciation decisions.</a> Journal of Experimental Psychology: Learning, Memory, and Cognition. 29 (6), 1231 (2003).</li><li>Ren, G. -. Q., Liu, Y., Han, Y. -. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phonological+activation+in+chinese+reading:+an+event-related+potential+study+using+low-resolution+electromagnetic+tomography.">Phonological activation in chinese reading: an event-related potential study using low-resolution electromagnetic tomography.</a> Neuroscience. 164 (4), 1623-1631 (2009).</li><li>Wang, K., Mecklinger, A., Hofmann, J., Weng, X. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=From+orthography+to+meaning:+an+electrophysiological+investigation+of+the+role+of+phonology+in+accessing+meaning+of+Chinese+single-character+words.">From orthography to meaning: an electrophysiological investigation of the role of phonology in accessing meaning of Chinese single-character words.</a> Neuroscience. 165 (1), 101-106 (2010).</li><li>Wong, A. -. K., Wu, Y., Chen, H. -. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Limited+role+of+phonology+in+reading+Chinese+two-character+compounds:+Evidence+from+an+ERP+study.">Limited role of phonology in reading Chinese two-character compounds: Evidence from an ERP study.</a> Neuroscience. 256, 342-351 (2014).</li><li>Meng, X., Jian, J., Shu, H., Tian, X., Zhou, X. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=ERP+correlates+of+the+development+of+orthographical+and+phonological+processing+during+Chinese+sentence+reading.">ERP correlates of the development of orthographical and phonological processing during Chinese sentence reading.</a> Brain research. 1219, 91-102 (2008).</li><li>Liu, B., Jin, Z., Qing, Z., Wang, Z. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+processing+of+phonological,+orthographical,+and+lexical+information+of+Chinese+characters+in+sentence+contexts:+an+ERP+study.">The processing of phonological, orthographical, and lexical information of Chinese characters in sentence contexts: an ERP study.</a> Brain research. 1372, 81-91 (2011).</li><li>Leminen, A., Smolka, E., Dunabeitia, J. A., Pliatsikas, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Morphological+processing+in+the+brain:+The+good+(inflection),+the+bad+(derivation)+and+the+ugly+(compounding).">Morphological processing in the brain: The good (inflection), the bad (derivation) and the ugly (compounding).</a> Cortex. 116, 4-44 (2019).</li><li>Pylkk&#228;nen, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+neural+basis+of+combinatory+syntax+and+semantics.">The neural basis of combinatory syntax and semantics.</a> Science. 366 (6461), 62-66 (2019).</li><li>Halgren, E., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=N400-like+magnetoencephalography+responses+modulated+by+semantic+context,+word+frequency,+and+lexical+class+in+sentences.">N400-like magnetoencephalography responses modulated by semantic context, word frequency, and lexical class in sentences.</a> Neuroimage. 17 (3), 1101-1116 (2002).</li><li>Huang, Y., Jiang, M., Guo, Q., Wang, Y., Yang, F. -. P. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dissociation+of+the+confounding+influences+of+expectancy+and+integrative+difficulty+residing+in+anomalous+sentences+in+event-related+potential+studies.">Dissociation of the confounding influences of expectancy and integrative difficulty residing in anomalous sentences in event-related potential studies.</a> Journal of Visualized Experiments. (147), e59436 (2019).</li><li>Wang, Y., Jiang, M., Huang, Y., Qiu, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=An+ERP+study+on+the+role+of+phonological+processing+in+reading+two-character+compound+chinese+words+of+high+and+low+frequency.">An ERP study on the role of phonological processing in reading two-character compound chinese words of high and low frequency.</a> Frontiers in Psychology. 12, 637238 (2021).</li><li>Carreiras, M., Vergara, M., Barber, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Early+event-related+potential+effects+of+syllabic+processing+during+visual+word+recognition.">Early event-related potential effects of syllabic processing during visual word recognition.</a> Journal of Cognitive Neuroscience. 17 (11), 1803-1817 (2005).</li><li>Hauk, O., Davis, M. H., Ford, M., Pulvermuller, F., Marslen-Wilson, W. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+time+course+of+visual+word+recognition+as+revealed+by+linear+regression+analysis+of+ERP+data.">The time course of visual word recognition as revealed by linear regression analysis of ERP data.</a> Neuroimage. 30 (4), 1383-1400 (2006).</li></ol>

Experimental results and significance: 
The purpose of this protocol was to infer the following: 1) whether the word recognition model is a feedforward model or an interactive model and 2) the interaction between the phonological and semantic patterns in Chinese two-character compound recognition of high and low frequency under different tasks. An interference paradigm of phonological and semantic matching task using the ERP technique was adopted. The ERP responses preceded by homophones and unrelat...

The critical issue in any word recognition model is understanding the role of phonology in the process of semantic access1. For alphabetic languages, many studies consistently view phonology as playing an important role in semantic access, including English2,3,4, Hebrew5, French6, and Spanish7. In other words, written word recognition involves not only orthographic but also phonological and semantic processing. This observation in the interactive connectionist model is explained by extensions activated throughout the network, where orthography is associated with phonological and semantic representations through weighted connections8. This proliferation of activation provides the core mechanism for the visual word recognition model, which assumes that phonological and semantic representations are automatically activated in response to orthographic input9.
However, current empirical evidence supporting the hypothesis of interactive automation remains controversial. Some studies claim that the activation of phonological and semantic representations can be adjusted or prevented by task demands or attention, which implies a certain top-down influence on the high-level processes involved in word perception10,11. However, the aforementioned description has been questioned by many findings that report phonological and semantic effects in visual word recognition even though these representations are completely irrelevant to the task or cannot be directly accessed12, thereby supporting the view that semantics and phonology may be accessed automatically and forcibly during the reading process13. Therefore, there is uncertainty on whether the phonological and semantic activation in visual word recognition depends on the specific task or whether it occurs forcibly and automatically in a task-independent manner.
The answer to aforementioned question is difficult for Chinese readers. Compared to English, Chinese is a logographic script whose characters represent morphemes instead of phonemes14. At present, the role of phonology for semantic access to Chinese words remains controversial. Some studies have claimed that phonology plays an important role in semantic access to Chinese words15,16,17. Others, however, have held the opposite view18,19. After evaluating the aforementioned research for Chinese phonological processing, we found that the experimental paradigm and specific research methods differ. On the whole, it was mainly divided into two paradigms: word priming15,18,19 and violation paradigm in the sentence17,20,21. The target word is usually embedded at the end of the sentence in the violation paradigm22. In terms of language mechanism, a short two-word phrase is a more manageable unit than a complete sentence that is difficult to process23. In addition, variables that are difficult to control in a sentence, such as syntax, context, or other factors, may lead to different conclusions24. The word priming paradigm is a method commonly used to explore word recognition models, whether in alphabetic languages or Chinese. The task of this paradigm is to judge whether the target word preceded by the primes is a real word or pseudoword; that is, this paradigm usually contains only one lexical task. However, a single lexical decision task may not be the best choice to solve the problem of whether the activation of phonology and semantics depends on the task. Therefore, two different tasks may be more suitable for exploring this question.
Therefore, this research aimed to explore the role of phonology in Chinese word recognition and simultaneously attempt to determine whether the activation of phonology and semantics is in task independent. Our research includes two tasks using the interference paradigm: semantic judgment and phonological judgment. To the best of our knowledge, this is the first event-related potential (ERP) study of Chinese two-character compound recognition using this interference paradigm, and this method rarely appears in studies of alphabetic languages. Specifically, in the semantic judgment task, participants must judge whether the target word and its precedent are semantically related, while in the phonological task, they must judge whether the paired words have the same pronunciation.
The former is a semantic matching task that does not require a priori phonological processing, and the latter is a phonological judgment task that does not require a priori semantic processing. Therefore, we compared homophone pairs and unrelated control groups in the semantic judgment task to reveal whether and how phonology affects semantic processing. Similarly, we compared semantically related word pairs with unrelated control conditions in the phonological judgment task to reveal whether and how semantics affect phonological processing. In addition, the aforementioned problem was verified in high- and low-frequency words. Thus, this complementary semantic and phonological judgment task can not only reveal the importance of phonological processing in Chinese word recognition but also reveal whether and how phonology and semantics interact.
If the phonology and semantic processes are early, automatic, and interactive, the effect of phonological and semantic activation should be observed in the response time of the two tasks. For ERP, phonological and semantic processes trigger two different electrophysiological markers2,7. In addition, their time courses and their spatial distributions should be different. An early positive component (P200) should reflect phonological processing, and the typical semantic processing marker N400 should also be identified20,21. We assumed that both the phonologically related pairs in the semantic task and the semantic-related pairs in the phonological task would cause a significant decrease in N400, which would have indicated that phonological processing may lead to some degree of activation at lexical-semantic levels. In addition, we monitored whether the P200, which characterizes phonological processing, appeared in the semantic judgment task or the phonological judgment task. In the phonological judgment task, semantic-related conditions trigger the P200, which can be seen as evidence of the early influence of semantics on phonological processing.

<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td>BrainAmp DC amplifier system (Brain Products GmbH)</td>
			<td>Brain Products, Gilching, Germany</td>
			<td></td>
			<td>BrainAmp S/N AMP13061964DC Input 5.6DC=150mA Operation 7mA Standby</td>
		</tr>
		<tr>
			<td>Easycap (Brain Products GmbH)</td>
			<td>Brain Products, Gilching, Germany</td>
			<td></td>
			<td>62 Ag/AgCl electrodes with a configuration of the international 10&#8211;20 system of electrode</td>
		</tr>
	</tbody>
</table>

interaction between phonological and semantic processes in visual word recognition using electrophysiology

Controversies have always existed in research related to reading abilities; on whether printed words are perceived in a feedforward manner based on orthographic information after which, other representations, such as phonology and semantics are activated, or whether these are fully interactive and high-level semantic information affects early processing. An interference paradigm was implemented in the presented protocol of phonological and semantic judgment tasks that utilized the same precede-target pairs to explore the relative order of phonological and semantic activation. The high- and low-frequency target words were preceded with three conditions: semantically related, phonological-related (homophones), or unrelated. The results showed that the induced P200 component of low-frequency word pairs was significantly greater than high-frequency words in both the semantic and phonological tasks. In addition, both the homophones in the semantic task and the semantically related pairs in the phonological task caused reduction in N400 when compared to the the control condition, word frequency-independently. It is worth noting that for the low-frequency pairs in the phonological judgment task, the P200 released by the semantically related word pairs was significantly larger than that in the control condition. Overall, semantic processing in phonological tasks and phonological processing in semantic tasks were found in both high- and low-frequency words, suggesting that the interaction between semantics and phonology may operate in a task-independent manner. However, the specific time this interaction occurred may have been affected by the task and frequency.

This protocol was used in a recent study to investigate the role of phonology in Chinese two-character compound recognition and to infer the word recognition model26. All stimuli used in this study were fully disclosed26. Three time windows were selected on the basis of global field power (GFP): at 100-150 ms, 160-280 ms, and 300- 500 ms for N1, P200, and N400 components, respectively26. The average amplitudes of the above two time windows were analy...

Watch this Scientific Journal Video about Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology at JoVE.com

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

We present a protocol to explore the relative activation sequence of phonology and semantics in visual word recognition. The results show that consistent with interactive accounts, semantic and phonological representations may be processed interactively, and higher-level linguistic representations may affect early processing.

Controversies have always existed in research related to reading abilities; on whether printed words are perceived in a feedforward manner based on ...

Research

JoVE Journal

Behavior

Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension

The present article describes how to use eye  tracking methodologies to study the cognitive processes involved in text  comprehension. Measuring eye ...

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior

Kinesthetic awareness is important to successfully navigate the environment. When we interact with our daily surroundings, some aspects of movement are ...

Investigating the Effects of Antipsychotics and Schizotypy on the N400 Using Event-Related Potentials and Semantic Categorization

Within the field of cognitive neuroscience, functional magnetic resonance imaging (fMRI) is a popular method of visualizing brain function. This is in ...

The Modified Hole Board - Measuring Behavior, Cognition and Social Interaction in Mice and Rats

This protocol describes the modified hole board (mHB), which combines features from a traditional hole board and open field and is designed to measure ...

A Mouse Model of Subchronic and Mild Social Defeat Stress for Understanding Stress-induced Behavioral and Physiological Deficits

Stressful life events often increase the incidence of depression in humans. To study the mechanisms of depression, the development of animal models of ...

Novel Object Recognition Test for the Investigation of Learning and Memory in Mice

The object recognition test (ORT) is a commonly used behavioral assay for the investigation of various aspects of learning and memory in mice. The ORT is ...

A Semantic Priming Event-related Potential (ERP) Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder

A Semantic Priming Event-related Potential ERP Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) have characteristic deficits in understanding the meaning of language, or semantic processing. However, ...

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

The present work is a description and an assessment of a methodology designed to quantify different aspects of the interaction between language processing ...

An Electrophysiology Protocol to Measure Reward Anticipation and Processing in Children

We present a protocol designed to measure the neural correlates of reward in children. The protocol allows researchers to measure both reward anticipation ...

Visual Classical Conditioning in Wood Ants

Several species of insects have become model systems for studying learning and memory formation. Although many studies focus on freely moving animals, ...