Name: interaction between phonological and semantic processes in visual word recognition using electrophysiology
Uploaded: 2021-06-29T14:00:00
Description: Watch this Scientific Journal Video about Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology at JoVE.com

This work was supported by Major Program of the National Natural Science Foundation of China (62036001).

The protocol used for this study was approved by the Institutional Review Board of Tsinghua University.
1. Stimuli construction and presentation
<ol>
	<li>Stimuli construction
	<ol>
		<li>Stimuli preparation: Prepare target words containing approximately 140 Chinese two-character compounds, of which low- and high-frequency words account for half. Precede each target by three analogues: a phonologically identical word (homonymous word), a word with related meaning, and an irrelevant control w...

<ol>
	<li>Carreiras, M., Armstrong, B. C., Perea, M., Frost, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+what,+when,+where,+and+how+of+visual+word+recognition.">The what, when, where, and how of visual word recognition.</a> Trends in Cognitive Sciences. 18 (2), 90-98 (2014).</li><li>Grainger, J., Kiyonaga, K., Holcomb, P. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+time+course+of+orthographic+and+phonological+code+activation.">The time course of orthographic and phonological code activation.</a> Psychological Science. 17 (12), 1021-1026 (2006).</li><li>Ashby, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phonology+is+fundamental+in+skilled+reading:+Evidence+from+ERPs.">Phonology is fundamental in skilled reading: Evidence from ERPs.</a> Psychonomic Bulletin Review. 17 (1), 95-100 (2010).</li><li>Wilson, L. B., Tregellas, J. R., Slason, E., Pasko, B. E., Rojas, D. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Implicit+phonological+priming+during+visual+word+recognition.">Implicit phonological priming during visual word recognition.</a> Neuroimage. 55 (2), 724-731 (2011).</li><li>Frost, R., Ahissar, M., Gotesman, R., Tayeb, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Are+phonological+effects+fragile?+The+effect+of+luminance+and+exposure+duration+on+form+priming+and+phonological+priming.">Are phonological effects fragile? The effect of luminance and exposure duration on form priming and phonological priming.</a> Journal of Memory and Language. 48 (2), 346-378 (2003).</li><li>Ferrand, L., Grainger, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effects+of+orthography+are+independent+of+phonology+in+masked+form+priming.">Effects of orthography are independent of phonology in masked form priming.</a> The Quarterly Journal of Experimental Psychology. 47 (2), 365-382 (1994).</li><li>Carreiras, M., Perea, M., Vergara, M., Pollatsek, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+time+course+of+orthography+and+phonology:+ERP+correlates+of+masked+priming+effects+in+Spanish.">The time course of orthography and phonology: ERP correlates of masked priming effects in Spanish.</a> Psychophysiology. 46 (5), 1113-1122 (2009).</li><li>Pattamadilok, C., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automaticity+of+phonological+and+semantic+processing+during+visual+word+recognition.">Automaticity of phonological and semantic processing during visual word recognition.</a> Neuroimage. 149, 244-255 (2017).</li><li>Harm, M. W., Seidenberg, M. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Computing+the+meanings+of+words+in+reading:+Cooperative+division+of+labor+between+visual+and+phonological+processes.">Computing the meanings of words in reading: Cooperative division of labor between visual and phonological processes.</a> Psychological Review. 111 (3), 662-720 (2004).</li><li>Brown, M. S., Roberts, M. A., Besner, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Semantic+processing+in+visual+word+recognition:+Activation+blocking+and+domain+specificity.">Semantic processing in visual word recognition: Activation blocking and domain specificity.</a> Psychonomic Bulletin &amp; Review. 8 (4), 778-784 (2001).</li><li>Devlin, J. T., Matthews, P. M., Rushworth, M. F. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Semantic+processing+in+the+left+inferior+prefrontal+cortex:+A+combined+functional+magnetic+resonance+imaging+and+transcranial+magnetic+stimulation+study.">Semantic processing in the left inferior prefrontal cortex: A combined functional magnetic resonance imaging and transcranial magnetic stimulation study.</a> Journal of Cognitive Neuroscience. 15 (1), 71-84 (2003).</li><li>Rodd, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=When+do+leotards+get+their+spots?+Semantic+activation+of+lexical+neighbors+in+visual+word+recognition.">When do leotards get their spots? Semantic activation of lexical neighbors in visual word recognition.</a> Psychonomic Bulletin &amp; Review. 11 (3), 434-439 (2004).</li><li>Frost, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Toward+a+strong+phonological+theory+of+visual+word+recognition:+True+issues+and+false+trails.">Toward a strong phonological theory of visual word recognition: True issues and false trails.</a> Psychological Bulletin. 123 (1), 71-99 (1998).</li><li>Yu, L., Reichle, E. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Chinese+versus+English:+Insights+on+cognition+during+reading.">Chinese versus English: Insights on cognition during reading.</a> Trends in Cognitive Sciences. 21 (10), 721-724 (2017).</li><li>Tan, L. H., Perfetti, C. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phonological+activation+in+visual+identification+of+Chinese+two-character+words.">Phonological activation in visual identification of Chinese two-character words.</a> Journal of Experimental Psychology: Learning, Memory, and Cognition. 25 (2), 382 (1999).</li><li>Liu, Y., Perfetti, C. A., Hart, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=ERP+evidence+for+the+time+course+of+graphic,+phonological,+and+semantic+information+in+Chinese+meaning+and+pronunciation+decisions.">ERP evidence for the time course of graphic, phonological, and semantic information in Chinese meaning and pronunciation decisions.</a> Journal of Experimental Psychology: Learning, Memory, and Cognition. 29 (6), 1231 (2003).</li><li>Ren, G. -. Q., Liu, Y., Han, Y. -. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phonological+activation+in+chinese+reading:+an+event-related+potential+study+using+low-resolution+electromagnetic+tomography.">Phonological activation in chinese reading: an event-related potential study using low-resolution electromagnetic tomography.</a> Neuroscience. 164 (4), 1623-1631 (2009).</li><li>Wang, K., Mecklinger, A., Hofmann, J., Weng, X. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=From+orthography+to+meaning:+an+electrophysiological+investigation+of+the+role+of+phonology+in+accessing+meaning+of+Chinese+single-character+words.">From orthography to meaning: an electrophysiological investigation of the role of phonology in accessing meaning of Chinese single-character words.</a> Neuroscience. 165 (1), 101-106 (2010).</li><li>Wong, A. -. K., Wu, Y., Chen, H. -. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Limited+role+of+phonology+in+reading+Chinese+two-character+compounds:+Evidence+from+an+ERP+study.">Limited role of phonology in reading Chinese two-character compounds: Evidence from an ERP study.</a> Neuroscience. 256, 342-351 (2014).</li><li>Meng, X., Jian, J., Shu, H., Tian, X., Zhou, X. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=ERP+correlates+of+the+development+of+orthographical+and+phonological+processing+during+Chinese+sentence+reading.">ERP correlates of the development of orthographical and phonological processing during Chinese sentence reading.</a> Brain research. 1219, 91-102 (2008).</li><li>Liu, B., Jin, Z., Qing, Z., Wang, Z. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+processing+of+phonological,+orthographical,+and+lexical+information+of+Chinese+characters+in+sentence+contexts:+an+ERP+study.">The processing of phonological, orthographical, and lexical information of Chinese characters in sentence contexts: an ERP study.</a> Brain research. 1372, 81-91 (2011).</li><li>Leminen, A., Smolka, E., Dunabeitia, J. A., Pliatsikas, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Morphological+processing+in+the+brain:+The+good+(inflection),+the+bad+(derivation)+and+the+ugly+(compounding).">Morphological processing in the brain: The good (inflection), the bad (derivation) and the ugly (compounding).</a> Cortex. 116, 4-44 (2019).</li><li>Pylkk&#228;nen, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+neural+basis+of+combinatory+syntax+and+semantics.">The neural basis of combinatory syntax and semantics.</a> Science. 366 (6461), 62-66 (2019).</li><li>Halgren, E., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=N400-like+magnetoencephalography+responses+modulated+by+semantic+context,+word+frequency,+and+lexical+class+in+sentences.">N400-like magnetoencephalography responses modulated by semantic context, word frequency, and lexical class in sentences.</a> Neuroimage. 17 (3), 1101-1116 (2002).</li><li>Huang, Y., Jiang, M., Guo, Q., Wang, Y., Yang, F. -. P. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dissociation+of+the+confounding+influences+of+expectancy+and+integrative+difficulty+residing+in+anomalous+sentences+in+event-related+potential+studies.">Dissociation of the confounding influences of expectancy and integrative difficulty residing in anomalous sentences in event-related potential studies.</a> Journal of Visualized Experiments. (147), e59436 (2019).</li><li>Wang, Y., Jiang, M., Huang, Y., Qiu, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=An+ERP+study+on+the+role+of+phonological+processing+in+reading+two-character+compound+chinese+words+of+high+and+low+frequency.">An ERP study on the role of phonological processing in reading two-character compound chinese words of high and low frequency.</a> Frontiers in Psychology. 12, 637238 (2021).</li><li>Carreiras, M., Vergara, M., Barber, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Early+event-related+potential+effects+of+syllabic+processing+during+visual+word+recognition.">Early event-related potential effects of syllabic processing during visual word recognition.</a> Journal of Cognitive Neuroscience. 17 (11), 1803-1817 (2005).</li><li>Hauk, O., Davis, M. H., Ford, M., Pulvermuller, F., Marslen-Wilson, W. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+time+course+of+visual+word+recognition+as+revealed+by+linear+regression+analysis+of+ERP+data.">The time course of visual word recognition as revealed by linear regression analysis of ERP data.</a> Neuroimage. 30 (4), 1383-1400 (2006).</li></ol>

Experimental results and significance: 
The purpose of this protocol was to infer the following: 1) whether the word recognition model is a feedforward model or an interactive model and 2) the interaction between the phonological and semantic patterns in Chinese two-character compound recognition of high and low frequency under different tasks. An interference paradigm of phonological and semantic matching task using the ERP technique was adopted. The ERP responses preceded by homophones and unrelat...

The critical issue in any word recognition model is understanding the role of phonology in the process of semantic access1. For alphabetic languages, many studies consistently view phonology as playing an important role in semantic access, including English2,3,4, Hebrew5, French6, and Spanish7. In other words, written word recognition involves not only orthographic but also phonological and semantic processing. This observation in the interactive connectionist model is explained by extensions activated throughout the network, where orthography is associated with phonological and semantic representations through weighted connections8. This proliferation of activation provides the core mechanism for the visual word recognition model, which assumes that phonological and semantic representations are automatically activated in response to orthographic input9.
However, current empirical evidence supporting the hypothesis of interactive automation remains controversial. Some studies claim that the activation of phonological and semantic representations can be adjusted or prevented by task demands or attention, which implies a certain top-down influence on the high-level processes involved in word perception10,11. However, the aforementioned description has been questioned by many findings that report phonological and semantic effects in visual word recognition even though these representations are completely irrelevant to the task or cannot be directly accessed12, thereby supporting the view that semantics and phonology may be accessed automatically and forcibly during the reading process13. Therefore, there is uncertainty on whether the phonological and semantic activation in visual word recognition depends on the specific task or whether it occurs forcibly and automatically in a task-independent manner.
The answer to aforementioned question is difficult for Chinese readers. Compared to English, Chinese is a logographic script whose characters represent morphemes instead of phonemes14. At present, the role of phonology for semantic access to Chinese words remains controversial. Some studies have claimed that phonology plays an important role in semantic access to Chinese words15,16,17. Others, however, have held the opposite view18,19. After evaluating the aforementioned research for Chinese phonological processing, we found that the experimental paradigm and specific research methods differ. On the whole, it was mainly divided into two paradigms: word priming15,18,19 and violation paradigm in the sentence17,20,21. The target word is usually embedded at the end of the sentence in the violation paradigm22. In terms of language mechanism, a short two-word phrase is a more manageable unit than a complete sentence that is difficult to process23. In addition, variables that are difficult to control in a sentence, such as syntax, context, or other factors, may lead to different conclusions24. The word priming paradigm is a method commonly used to explore word recognition models, whether in alphabetic languages or Chinese. The task of this paradigm is to judge whether the target word preceded by the primes is a real word or pseudoword; that is, this paradigm usually contains only one lexical task. However, a single lexical decision task may not be the best choice to solve the problem of whether the activation of phonology and semantics depends on the task. Therefore, two different tasks may be more suitable for exploring this question.
Therefore, this research aimed to explore the role of phonology in Chinese word recognition and simultaneously attempt to determine whether the activation of phonology and semantics is in task independent. Our research includes two tasks using the interference paradigm: semantic judgment and phonological judgment. To the best of our knowledge, this is the first event-related potential (ERP) study of Chinese two-character compound recognition using this interference paradigm, and this method rarely appears in studies of alphabetic languages. Specifically, in the semantic judgment task, participants must judge whether the target word and its precedent are semantically related, while in the phonological task, they must judge whether the paired words have the same pronunciation.
The former is a semantic matching task that does not require a priori phonological processing, and the latter is a phonological judgment task that does not require a priori semantic processing. Therefore, we compared homophone pairs and unrelated control groups in the semantic judgment task to reveal whether and how phonology affects semantic processing. Similarly, we compared semantically related word pairs with unrelated control conditions in the phonological judgment task to reveal whether and how semantics affect phonological processing. In addition, the aforementioned problem was verified in high- and low-frequency words. Thus, this complementary semantic and phonological judgment task can not only reveal the importance of phonological processing in Chinese word recognition but also reveal whether and how phonology and semantics interact.
If the phonology and semantic processes are early, automatic, and interactive, the effect of phonological and semantic activation should be observed in the response time of the two tasks. For ERP, phonological and semantic processes trigger two different electrophysiological markers2,7. In addition, their time courses and their spatial distributions should be different. An early positive component (P200) should reflect phonological processing, and the typical semantic processing marker N400 should also be identified20,21. We assumed that both the phonologically related pairs in the semantic task and the semantic-related pairs in the phonological task would cause a significant decrease in N400, which would have indicated that phonological processing may lead to some degree of activation at lexical-semantic levels. In addition, we monitored whether the P200, which characterizes phonological processing, appeared in the semantic judgment task or the phonological judgment task. In the phonological judgment task, semantic-related conditions trigger the P200, which can be seen as evidence of the early influence of semantics on phonological processing.

<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td>BrainAmp DC amplifier system (Brain Products GmbH)</td>
			<td>Brain Products, Gilching, Germany</td>
			<td></td>
			<td>BrainAmp S/N AMP13061964DC Input 5.6DC=150mA Operation 7mA Standby</td>
		</tr>
		<tr>
			<td>Easycap (Brain Products GmbH)</td>
			<td>Brain Products, Gilching, Germany</td>
			<td></td>
			<td>62 Ag/AgCl electrodes with a configuration of the international 10&#8211;20 system of electrode</td>
		</tr>
	</tbody>
</table>

interaction between phonological and semantic processes in visual word recognition using electrophysiology

Controversies have always existed in research related to reading abilities; on whether printed words are perceived in a feedforward manner based on orthographic information after which, other representations, such as phonology and semantics are activated, or whether these are fully interactive and high-level semantic information affects early processing. An interference paradigm was implemented in the presented protocol of phonological and semantic judgment tasks that utilized the same precede-target pairs to explore the relative order of phonological and semantic activation. The high- and low-frequency target words were preceded with three conditions: semantically related, phonological-related (homophones), or unrelated. The results showed that the induced P200 component of low-frequency word pairs was significantly greater than high-frequency words in both the semantic and phonological tasks. In addition, both the homophones in the semantic task and the semantically related pairs in the phonological task caused reduction in N400 when compared to the the control condition, word frequency-independently. It is worth noting that for the low-frequency pairs in the phonological judgment task, the P200 released by the semantically related word pairs was significantly larger than that in the control condition. Overall, semantic processing in phonological tasks and phonological processing in semantic tasks were found in both high- and low-frequency words, suggesting that the interaction between semantics and phonology may operate in a task-independent manner. However, the specific time this interaction occurred may have been affected by the task and frequency.

This protocol was used in a recent study to investigate the role of phonology in Chinese two-character compound recognition and to infer the word recognition model26. All stimuli used in this study were fully disclosed26. Three time windows were selected on the basis of global field power (GFP): at 100-150 ms, 160-280 ms, and 300- 500 ms for N1, P200, and N400 components, respectively26. The average amplitudes of the above two time windows were analy...

Watch this Scientific Journal Video about Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology at JoVE.com

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

We present a protocol to explore the relative activation sequence of phonology and semantics in visual word recognition. The results show that consistent with interactive accounts, semantic and phonological representations may be processed interactively, and higher-level linguistic representations may affect early processing.

Controversies have always existed in research related to reading abilities; on whether printed words are perceived in a feedforward manner based on ...

This protocol can help observe the specific interaction between phonological and semantic patterns in Chinese two-character compound recognition, and infer whether the word recognition is a feedforward or an interactive model. The main advantage is the presence of two distinct tasks of the interference paradigm, which is more conducive to exploring whether the interaction between phonology and semantics is task-independent, and how to interact under different tasks. It would be advisable to strictly control the frequency and the semantic relevance of the materials.In addition, try to minimize the repetition of target words in each block. Begin by instructing the participant to properly clean their scalp and dry their hair in the laboratory. Invite the participants to sit comfortably on a chair in the chamber where the experiment will be conducted.Instruct them not to move the chair. Use cotton swabs and facial scrubs to clean the skin under the participant's left eye for attaching the vertical electro-oculographic electrode, near the outer canthus of the right eye for the horizontal electro-oculographic electrode, and around the right and left mastoid bones for TP9 and TP10, which will be used as new offline references. Place the elastic cap on the participant's head, and make sure that the Cz electrode is at the center of the top of the head.Fix the electrode cap strap under the chin, with care to ensure that it is not too tight or too loose. Make sure that the cap and amplifier are connected to the recording system. Next, switch the recording software to the impedance monitoring interface.Ensure that the impedance of all electrodes does not exceed 5 kilo-ohms or 10 kilo-ohms. Starting with the reference and ground electrodes, pass the syringe filled with conductive gel through the small hole of an electrode to the scalp, and push the plunger to inject a small amount of conductive gel into the scalp, while being careful not to cause an overflow. Monitor the display system that displays the impedance in real time until the impedance drops to the threshold.After the reference and ground electrodes are prepared, reduce the impedance of the other electrodes in the same way. Tape the small holes on one side of the two electro-oculographic electrodes to prevent the injected conductive gel from leaking. Fix the electrodes to the bottom of the left eye and the outer canthus of the right eye, with tape.After all the electrodes are prepared, instruct the participants to relax and avoid excessive eye blinking and body movement during the experiment. Present the stimulus via the stimulus demonstration program, and let the participants practice in the practice section. Start the formal experiment and record the EEG information.If an electrode is loose or the resistance exceeds the threshold, refill the electrode when the participant is resting. Monitor the recording system while recording the EEG information. After the experiment is completed, save the EEG signal and turn off the recording system and amplifier.Then take off the participant's cap and instruct the participant to wash off the conductive gel from the hair and skin. Finally, reward the participants and thank them for their cooperation. Select semi-automatic ocular correction with independent component analysis.Compute the event-related potentials from 100 milliseconds to 600 milliseconds after the onset of the target word, with 100 milliseconds as the pre-target baseline. Set the EEG bandpass-filtered offline from 0.05 to 30 Hertz. Discard epochs exceeding plus or minus 80 microvolts by artifact rejection, and eliminate the trials of erroneous responses.For high-frequency pairs in the 100 to 150 milliseconds period, it was observed that unrelated pairs elicited a significantly more negative waveform than homophone condition. In the 300 to 500 milliseconds time window for the midline electrodes, it was observed that a target primed by homophones elicited significantly less negative amplitude than did the unrelated condition. In the P200 time window, the event-related potential signal was significantly more positive under semantically-related conditions than under unrelated conditions.In the N400 time window for the midline electrodes, it was observed that the target primed by semantically-related words released a significantly less negative amplitude than unrelated primes. This protocol helps to observe the interaction between phonological and semantic processes in visual word recognition.

interaction-between-phonological-semantic-processes-visual-word

Research

JoVE Journal

Behavior

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior

Kinesthetic awareness is important to successfully navigate the environment. When we interact with our daily surroundings, some aspects of movement are deliberately planned, while others spontaneously occur below conscious awareness. The deliberate component of this dichotomy has been studied extensively in several contexts, while the spontaneous component remains largely under-explored. Moreover, how perceptual processes modulate these movement classes is still unclear. In particular, a currently debated issue is whether the visuomotor system is governed by the spatial percept produced by a visual illusion or whether it is not affected by the illusion and is governed instead by the veridical percept. Bistable percepts such as 3D depth inversion illusions (DIIs) provide an excellent context to study such interactions and balance, particularly when used in combination with reach-to-grasp movements. In this study, a methodology is developed that uses a DII to clarify the role of top-down processes on motor action, particularly exploring how reaches toward a target on a DII are affected in both deliberate and spontaneous movement domains.

It is unclear how top-down signals from the ventral visual stream affect movement. We developed a paradigm to test motor behavior towards a target on a 3D depth inversion illusion. Significant differences are reported in both deliberate, goal-directed movements and automatic actions under illusory and veridical viewing conditions.

Kinesthetic awareness is important to successfully navigate the environment. When we interact with our daily surroundings, some aspects of movement are ...

Investigating the Effects of Antipsychotics and Schizotypy on the N400 Using Event-Related Potentials and Semantic Categorization

Within the field of cognitive neuroscience, functional magnetic resonance imaging (fMRI) is a popular method of visualizing brain function. This is in part because of its excellent spatial resolution, which allows researchers to identify brain areas associated with specific cognitive processes. However, in the quest to localize brain functions, it is relevant to note that many cognitive, sensory, and motor processes have temporal distinctions that are imperative to capture, an aspect that is left unfulfilled by fMRI&#8217;s suboptimal temporal resolution. To better understand cognitive processes, it is thus advantageous to utilize event-related potential (ERP) recording as a method of gathering information about the brain. Some of its advantages include its fantastic temporal resolution, which gives researchers the ability to follow the activity of the brain down to the millisecond. It also directly indexes both excitatory and inhibitory post-synaptic potentials by which most brain computations are performed. This sits in contrast to fMRI, which captures an index of metabolic activity. Further, the non-invasive ERP method does not require a contrast condition: raw ERPs can be examined for just one experimental condition, a distinction from fMRI where control conditions must be subtracted from the experimental condition, leading to uncertainty in associating observations with experimental or contrast conditions. While it is limited by its poor spatial and subcortical activity resolution, ERP recordings&#8217; utility, relative cost-effectiveness, and associated advantages offer strong rationale for its use in cognitive neuroscience to track rapid temporal changes in neural activity. In an effort to foster increase in its use as a research imaging method, and to ensure proper and accurate data collection, the present article will outline &#8211; in the framework of a paradigm using semantic categorization to examine the effects of antipsychotics and schizotypy on the N400 &#8211; the procedure and key aspects associated with ERP data acquisition.

Using event-related EEG potentials (ERPs), we investigate the effects of antipsychotic medications on abnormal semantic brain activations in healthy individuals with schizotypal traits. We use ERPs to track distinct changes in brain activity, shedding insight into the cognitive processes associated with semantic categorization.

Within the field of cognitive neuroscience, functional magnetic resonance imaging (fMRI) is a popular method of visualizing brain function. This is in ...

The Modified Hole Board - Measuring Behavior, Cognition and Social Interaction in Mice and Rats

This protocol describes the modified hole board (mHB), which combines features from a traditional hole board and open field and is designed to measure multiple dimensions of unconditioned behavior in small laboratory mammals (e.g., mice, rats, tree shrews and small primates). This paradigm is a valuable alternative for the use of a behavioral test battery, since a broad behavioral spectrum of an animal&#8217;s behavioral profile can be investigated in one single test.
The apparatus consists of a box, representing the &#8216;protected&#8217; area, separated from a group compartment. A board, on which small cylinders are staggered in three lines, is placed in the center of the box, representing the &#8216;unprotected&#8217; area of the set-up. The cognitive abilities of the animals can be measured by baiting some cylinders on the board and measuring the working and reference memory. Other unconditioned behavior, such as activity-related-, anxiety-related- and social behavior, can be observed using this paradigm. Behavioral flexibility and the ability to habituate to a novel environment can additionally be observed by subjecting the animals to multiple trials in the mHB, revealing insight into the animals&#8217; adaptive capacities.
Due to testing order effects in a behavioral test battery, na&#239;ve animals should be used for each individual experiment. By testing multiple behavioral dimensions in a single paradigm and thereby circumventing this issue, the number of experimental animals used is reduced. Furthermore, by avoiding social isolation during testing and without the need to food deprive the animals, the mHB represents a behavioral test system, inducing if any, very low amount of stress.

This protocol describes the modified hole board, which is a behavioral test set-up that comprises the characteristics of an open field and a traditional hole board. This set-up enables the differential analysis of unconditioned behavior of small laboratory mammals as well as the analysis of cognitive abilities.

This protocol describes the modified hole board (mHB), which combines features from a traditional hole board and open field and is designed to measure ...

A Mouse Model of Subchronic and Mild Social Defeat Stress for Understanding Stress-induced Behavioral and Physiological Deficits

Stressful life events often increase the incidence of depression in humans. To study the mechanisms of depression, the development of animal models of depression is essential. Because there are several types of depression, various animal models are needed for a deeper understanding of the disorder. Previously, a mouse model of subchronic and mild social defeat stress (sCSDS) using a modified chronic social defeat stress (CSDS) paradigm was established. In the paradigm, to reduce physical injuries from aggressors, the duration of physical contact between the aggressor and a subordinate was reduced compared to in the original CSDS paradigm. sCSDS mice showed increased body weight gain, food intake, and water intake during the stress period, and their social behaviors were suppressed after the stress period. In terms of the face validity of the stress-induced overeating and overdrinking following the increased body weight gain, the sCSDS mice may show some features related to atypical depression in humans. Thus, a mouse model of sCSDS may be useful for studying the pathogenic mechanisms underlying depression. This protocol will help establish the sCSDS mouse model, especially for studying the mechanisms underlying stress-induced weight gain and polydipsia- and hyperphagia-like symptoms.

Here, methods for developing a mouse model of subchronic and mild social defeat stress are described and used to investigate the pathogenic features of depression including hyperphagia- and polydipsia-like symptoms following increased body weight.

Stressful life events often increase the incidence of depression in humans. To study the mechanisms of depression, the development of animal models of ...

Novel Object Recognition Test for the Investigation of Learning and Memory in Mice

The object recognition test (ORT) is a commonly used behavioral assay for the investigation of various aspects of learning and memory in mice. The ORT is fairly simple and can be completed over 3 days: habituation day, training day, and testing day. During training, the mouse is allowed to explore 2 identical objects. On test day, one of the training objects is replaced with a novel object. Because mice have an innate preference for novelty, if the mouse recognizes the familiar object, it will spend most of its time at the novel object. Due to this innate preference, there is no need for positive or negative reinforcement or long training schedules. Additionally, the ORT can also be modified for numerous applications. The retention interval can be shortened to examine short-term memory, or lengthened to probe long-term memory. Pharmacological intervention can be used at various times prior to training, after training, or prior to recall to investigate different phases of learning (i.e., acquisition, early or late consolidation, or recall). Overall, the ORT is a relatively low-stress, efficient test for memory in mice, and is appropriate for the detection of neuropsychological changes following pharmacological, biological, or genetic manipulations.

The object recognition test (ORT) is a simple and efficient assay for evaluating learning and memory in mice. The methodology is described below.

The object recognition test (ORT) is a commonly used behavioral assay for the investigation of various aspects of learning and memory in mice. The ORT is ...

A Semantic Priming Event-related Potential (ERP) Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) have characteristic deficits in understanding the meaning of language, or semantic processing. However, some evidence indicates that semantic processing of non-linguistic stimuli is intact, suggesting that semantic deficits may be language-specific. To appropriately characterize semantic processing deficits in individuals with ASD, comparison of within-modality linguistic (e.g., written words) and non-linguistic (e.g., pictures) stimuli is required. This paper describes such a methodology that makes use of a semantic priming paradigm during concurrent recording of electroencephalographic (EEG) data. EEG provides a dynamic measure of brain activity that is well-suited to characterize subtle differences in semantic processing that may not be observable at the behavioral level. The semantic priming paradigm presents a prime picture or word (e.g., dog) followed by a target picture or word that is either related (e.g., cat) or unrelated (e.g., pencil) to the prime. This paradigm can thus be used to evaluate semantic processing across different modalities, and to compare lexico-semantic and visuo-semantic processing abilities in individuals with ASD and how they might differ from TD individuals. The specific steps involved in creating the stimuli, performing the EEG testing, and analyzing the EEG data are discussed. Representative results illustrate how the N400 component of the event-related potential (ERP) is reduced following semantically-related prime-target pairs compared to unrelated pairs. Comparisons of the N400 between conditions, modalities, and groups can provide estimates of the success of semantic processing, and can thereby be used to characterize semantic deficits in individuals with ASD or other clinical populations.

A Semantic Priming Event-related Potential ERP Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder

This paper describes a semantic priming ERP task using within-modality pairs of pictures and words to investigate semantic processing in individuals with autism spectrum disorder (ASD).

Individuals with autism spectrum disorder (ASD) have characteristic deficits in understanding the meaning of language, or semantic processing. However, ...

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

The present work is a description and an assessment of a methodology designed to quantify different aspects of the interaction between language processing and the perception of the visual world. The recording of eye-gaze patterns has provided good evidence for the contribution of both the visual context and linguistic/world knowledge to language comprehension. Initial research assessed object-context effects to test&#160;theories of modularity in language processing. In the introduction, we describe how subsequent investigations have taken the role of the wider visual context in language processing as a research topic in its own right, asking questions such as how our visual perception of events and of speakers contributes to&#160;comprehension informed by&#160;comprehenders&#39; experience. Among the examined aspects of the visual context are actions, events, a speaker&#39;s gaze, and emotional facial expressions, as well as spatial object configurations. Following an overview of the eye-tracking method and its different applications, we list the key steps of the methodology in the protocol, illustrating how to successfully use it to study visually-situated language comprehension. A final section presents three sets of representative results and illustrates the benefits and limitations of eye tracking for investigating the interplay between the perception of the visual world and language comprehension.

The present article reviews an eye-tracking methodology for studies on language comprehension. To obtain reliable data, key steps of the protocol must be followed. Among these are the correct set-up of the eye tracker (e.g., ensuring good quality of the eye and head images) and accurate calibration.

The present work is a description and an assessment of a methodology designed to quantify different aspects of the interaction between language processing ...

Visual Classical Conditioning in Wood Ants

Several species of insects have become model systems for studying learning and memory formation. Although many studies focus on freely moving animals, studies implementing classical conditioning paradigms with harnessed insects have been important for investigating the exact cues that individuals learn and the neural mechanisms underlying learning and memory formation. Here we present a protocol for evoking visual associative learning in wood ants through classical conditioning. In this paradigm, ants are harnessed and presented with a visual cue (a blue cardboard), the conditional stimulus (CS), paired with an appetitive sugar reward, the unconditional stimulus (US). Ants perform a Maxilla-Labium Extension Reflex (MaLER), the unconditional response (UR), which can be used as a readout for learning. Training consists of 10 trials, separated by a 5-minute intertrial interval (ITI). Ants are also tested for memory retention 10 minutes or 1 hour after training. This protocol has the potential to allow researchers to analyze, in a precise and controlled manner, the details of visual memory formation and the neural basis of learning and memory formation in wood ants.

We present a protocol for the classical conditioning of harnessed ants that permits researchers to study visual learning and memory formation at a level of analysis not possible with freely moving individuals.

Several species of insects have become model systems for studying learning and memory formation. Although many studies focus on freely moving animals, ...

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Sentence comprehension relies on the ability to rapidly integrate different types of linguistic and non-linguistic information. However, there is currently a paucity of research exploring how preschool children with autism understand sentences using different types of cues. The mechanisms underlying sentence comprehension remains largely unclear. The present study presents a protocol to examine the sentence comprehension abilities of preschool children with autism. More specifically, a visual world paradigm of eye-tracking is used to explore the moment-to-moment sentence comprehension in the children. The paradigm has multiple advantages. First, it is sensitive to the time course of sentence comprehension and thus can provide rich information about how sentence comprehension unfolds over time. Second, it requires minimal task and communication demands, so it is ideal for testing children with autism. To further minimize the computational burden of children, the present study measures eye movements that arise as automatic responses to linguistic input rather than measuring eye movements that accompany conscious responses to spoken instructions.

We present a protocol to examine the use of morphological cues during real-time sentence comprehension by children with autism.

Sentence comprehension relies on the ability to rapidly integrate different types of linguistic and non-linguistic information. However, there is ...

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Older adults are slower at recognizing visual objects than younger adults. The same is true for recognizing that a letter string is a real word. People with Alzheimer&#39;s disease (AD) or Mild Cognitive Impairment (MCI) demonstrate even longer responses in written word recognition than elderly controls. Despite the general tendency towards slower recognition in aging and neurocognitive disorders, certain characteristics of words influence word recognition speed regardless of age or neuropathology (e.g., a word&#8217;s frequency of use). We present here a protocol for examining the influence of lexical characteristics on word recognition response times in a simple lexical decision experiment administered to younger and older adults and people with MCI or AD. In this experiment, participants are asked to decide as quickly and accurately as possible whether a given letter string is an actual word or not. We also describe mixed-effects models and principal components analysis that can be used to detect the influence of different types of lexical variables or individual characteristics of participants on word recognition speed.

This article describes how to implement a simple lexical decision experiment to assess written word recognition in neurologically healthy participants and in individuals with dementia and cognitive decline. We also provide a detailed description of reaction time analysis using principal components analysis (PCA) and mixed-effects modeling.

Older adults are slower at recognizing visual objects than younger adults. The same is true for recognizing that a letter string is a real word. People ...