Name: designing and implementing nervous system simulations on lego robots
Uploaded: 2013-05-25T14:00:00
Description: Watch this Scientific Journal Video about Designing and Implementing Nervous System Simulations on LEGO Robots at JoVE.com

We thank Dr. Chris Rogers (Tufts University) for programming and manuscript suggestions. We thank Alex Giuliano and Deborah Lee for video production support. 
Funding provided by an NSF Graduate Research Fellowship and an ONR MURI in Synthetic Biology.

1. Building the Robot Model 
<ol>
 <li>Choose a model organism to study that is well represented in the neuroethological literature. Invertebrates generally make good candidates because their relatively simple nervous systems have been well studied and are primarily comprised of innate reflexes. We will demonstrate this approach using the American Lobster, Homarus americanus. </li>
 <li>Select well-studied reflexive behaviors for modeling purposes. We have chosen the lobster's responses to antennal bend and...

<ol>
	<li>Braitenberg, V. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Taxis,+kinesis+and+decussation.">Taxis, kinesis and decussation.</a> Prog. in Brain Res. 17, 210-222 (1965).</li><li>Schregardus, D. S., Pieneman, A. W., Ter Maat, A., Jansen, R. F., Brouwer, F., Gahr, M. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+lightweight+telemetry+system+for+recording+neuronal+activity+in+freely+behaving+small+animals.">A lightweight telemetry system for recording neuronal activity in freely behaving small animals.</a> Journal of Neuroscience Methods. 155 (1), 62-71 (2006).</li><li>Kagaya, K., Takahata, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Readiness+discharge+for+spontaneous+initiation+of+walking+in+crayfish.">Readiness discharge for spontaneous initiation of walking in crayfish.</a> Journal of Neuroscience. 30 (4), 1348-1362 (2010).</li><li>Schrameck, J. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Crayfish+Swimming:+Alternating+Motor+Output+and+Giant+Fiber+Activity.">Crayfish Swimming: Alternating Motor Output and Giant Fiber Activity.</a> Science. 169 (3946), 698-700 (1970).</li><li>Kanz, J. E., Eberly, L. B., Cobbs, J. S., Pinsker, H. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Neuronal+correlates+of+siphon+withdrawal+in+freely+behaving+Aplysia.">Neuronal correlates of siphon withdrawal in freely behaving Aplysia.</a> J. Neurophysiol. 42 (6), 1538-1556 (1979).</li><li>Webb, B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Validating+biorobotic+models.">Validating biorobotic models.</a> Journal of Neural Engineering. 3, 1-20 (2006).</li><li>Wessnitzer, J., Asthenidis, A., Petrou, G., Webb, B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+cricket-controlled+robot+orienting+towards+a+sound+source.">A cricket-controlled robot orienting towards a sound source.</a> Proceedings of the 12th Annual conference on Towards autonomous robotic systems. , 1-12 (2011).</li><li>Grasso, F., Atema, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Integration+of+flow+and+chemical+sensing+for+guidance+of+autonomous+marine+robots+in+turbulent+flows.">Integration of flow and chemical sensing for guidance of autonomous marine robots in turbulent flows.</a> Environ. Fluid Mech. 2 (1), 95-114 (2002).</li><li>Westphal, A., Rulkov, N. F., Ayers, J., Brady, D., Hunt, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Controlling+a+lamprey-based+robot+with+an+electronic+nervous+system.">Controlling a lamprey-based robot with an electronic nervous system.</a> Smart Struct. and Systems. 8 (1), 39-52 (2011).</li><li>Chao, Z. C., Bakkum, D. J., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Shaping+embodied+neural+networks+for+adaptive+goal-directed+behavior.">Shaping embodied neural networks for adaptive goal-directed behavior.</a> PLoS Computational Biology. 4 (3), e1000042 (2008).</li><li>Blustein, D., Schultheis, K., Ayers, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Building+nervous+systems+for+robots:+an+interactive+and+collaborative+neuroscience+curriculum.">Building nervous systems for robots: an interactive and collaborative neuroscience curriculum.</a> , (2011).</li><li>Ayers, J., Blustein, D., Westphal, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+Conserved+Biomimetic+Control+Architecture+for+Walking,+Swimming+and+Flying+Robots.">A Conserved Biomimetic Control Architecture for Walking, Swimming and Flying Robots.</a> Lect. Notes on Artif. Intelli. 7375, 1-12 (2012).</li><li>Cowan, N., Ma, E., Cutkosky, M., Full, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+Biologically+Inspired+Passive+Antenna+for+Steering+Control+of+a+Running+Robot.">A Biologically Inspired Passive Antenna for Steering Control of a Running Robot.</a> , 541-550 (2003).</li><li>Gasperi, M., Hurbain, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Extreme NXT: Extending the LEGO MINDSTORMS NXT to the Next Level. , (2007).</li><li>Gasperi, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> LabVIEW for LEGO MINDSTORMS NXT. , (2008).</li><li>Kennedy, D., Davis, W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Chapter+27+Organization+of+invertebrate+motor+systems.">Chapter 27 Organization of invertebrate motor systems.</a> Handbook of Physiology. 1, 1023-1088 (1977).</li><li>Buchanan, J., Grillner, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Newly+identified+"glutamate+interneurons"+and+their+role+in+locomotion+in+the+lamprey+spinal+cord.">Newly identified "glutamate interneurons" and their role in locomotion in the lamprey spinal cord.</a> Science. 236 (4799), 312-314 (1987).</li><li>Rulkov, N. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Modeling+of+spiking-bursting+neural+behavior+using+two-dimensional+map.">Modeling of spiking-bursting neural behavior using two-dimensional map.</a> Physical Review E. 65, (2002).</li><li>Derby, C. D., Atema, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Narrow-spectrum+chemoreceptor+cells+in+the+walking+legs+of+the+lobster,+Homarus+americanus:+Taste+specialists.">Narrow-spectrum chemoreceptor cells in the walking legs of the lobster, Homarus americanus: Taste specialists.</a> Journal of Comparative Physiology A. 146 (2), 181-189 (1982).</li><li>Tort, A. B. L., Neto, W. P., Amaral, O. B., Kazlauckas, V., Souza, D. O., Lara, D. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+simple+webcam-based+approach+for+the+measurement+of+rodent+locomotion+and+other+behavioural+parameters.">A simple webcam-based approach for the measurement of rodent locomotion and other behavioural parameters.</a> Journal of Neuroscience Methods. 157 (1), 91-97 (2006).</li><li>Huxley, T. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> The Crayfish, An Introduction to the Study of Zoology. , (1880).</li><li>Blustein, D., Ayers, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+conserved+network+for+control+of+arthropod+exteroceptive+optical+flow+reflexes+during+locomotion.">A conserved network for control of arthropod exteroceptive optical flow reflexes during locomotion.</a> Lect. Notes on Artif. Intelli. 6226, 72-81 (2010).</li><li>Webb, B., Scutt, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+simple+latency-dependent+spiking-neuron+model+of+cricket+phonotaxis.">A simple latency-dependent spiking-neuron model of cricket phonotaxis.</a> Biological Cybernetics. 82 (3), 247-269 (2000).</li><li>Demarse, T. B., Wagenaar, D. A., Blau, A. W., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Neurally+Controlled+Animat:+Biological+Brains+Acting+with+Simulated+Bodies.">The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies.</a> Autonomous Robots. 11 (3), 305-310 (2001).</li><li>Novellino, A., D'Angelo, P., Cozzi, L., Chiappalone, M., Sanguineti, V., Martinoia, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Connecting+neurons+to+a+mobile+robot:+an+in+vitro+bidirectional+neural+interface.">Connecting neurons to a mobile robot: an in vitro bidirectional neural interface.</a> Computational Intelligence and Neuroscience. , 12725 (2007).</li></ol>

When initiating biorobotic nervous system simulation experiments, there are a few important guidelines to follow. Choosing the right model organism is critical: pick an organism that is easy to obtain and maintain. Invertebrates are ideal because they do not usually require institutional approval for experimentation and their husbandry needs are often less demanding than those of vertebrates. From a scientific perspective, it is beneficial to choose an animal that has an established neuroethological literature record fro...

Neurophysiological investigations over the past 100 years have broadened tremendously our knowledge of nervous system structure and function. However, the majority of nervous system research to date has relied on the use of isolated preparations or restrained subjects. While there have been many successful efforts to record neural activity from freely behaving animals2-5, the biorobotic approach provides a valuable tool to allow for nervous system manipulation in order to test systems level neuroscience hypotheses6. Simulated nervous systems operating on robots can be experimentally manipulated and allow for the extension of software modeling to the physical world. This approach has been well implemented in the academic world7,8 but the process of building a biomimetic robot for hypothesis testing can be expensive and time consuming. We present a method to execute the biorobotic approach using a commercially available robotics kit (LEGO Mindstorms NXT 2.0). The goal of this method is to provide a rapid and efficient way to test systems level neuroscience hypotheses on robotic9 or bio-hybrid10 embodied neural network simulations. Accelerating the process from hypothesis to experiment improves research productivity. The simple LEGO Mindstorms platform provides a test bed for biomimetic sensors and neural networks which we demonstrate using the American Lobster (Homarus americanus) as a model organism. The method also provides a powerful hands-on educational tool in the classroom as students can design and manipulate nervous systems for their own robots11.

designing and implementing nervous system simulations on lego robots

We present a method to use the commercially available LEGO Mindstorms NXT robotics platform to test systems level neuroscience hypotheses. The first step of the method is to develop a nervous system simulation of specific reflexive behaviors of an appropriate model organism; here we use the American Lobster. Exteroceptive reflexes mediated by decussating (crossing) neural connections can explain an animal's taxis towards or away from a stimulus as described by Braitenberg and are particularly well suited for investigation using the NXT platform.1 The nervous system simulation is programmed using LabVIEW software on the LEGO Mindstorms platform. Once the nervous system is tuned properly, behavioral experiments are run on the robot and on the animal under identical environmental conditions. By controlling the sensory milieu experienced by the specimens, differences in behavioral outputs can be observed. These differences may point to specific deficiencies in the nervous system model and serve to inform the iteration of the model for the particular behavior under study. This method allows for the experimental manipulation of electronic nervous systems and serves as a way to explore neuroscience hypotheses specifically regarding the neurophysiological basis of simple innate reflexive behaviors. The LEGO Mindstorms NXT kit provides an affordable and efficient platform on which to test preliminary biomimetic robot control schemes. The approach is also well suited for the high school classroom to serve as the foundation for a hands-on inquiry-based biorobotics curriculum.

Inputs from a lobster's claws into its nervous system mediate obstacle negotiation in a novel environment. Figure 1 shows a screenshot of the video used to analyze the behavior of a LEGO robot (Figure 1A) and a lobster (Figure 1B) in the test arena. The test arena was unmodified between animal and robot tests except that the water was emptied from the tank for the robot trials.
Video tracking results are displayed in Figure 2....

Watch this Scientific Journal Video about Designing and Implementing Nervous System Simulations on LEGO Robots at JoVE.com

Designing and Implementing Nervous System Simulations on LEGO Robots

An approach to neural network modeling on the LEGO Mindstorms robotics platform is presented. The method provides a simulation tool for invertebrate neuroscience research in both the research lab and the classroom. This technique enables the investigation of biomimetic robot control principles.

We present a method to use the commercially available LEGO Mindstorms NXT robotics platform to test systems level neuroscience hypotheses. The first step ...

Research

JoVE Journal

Neuroscience

Visualization of the Embryonic Nervous System in Whole-mount Drosophila Embryos

Visualization of the Embryonic Nervous System in Whole-mount Drosophila Embryos

The Drosophila embryo is an attractive model system for investigating the cellular and molecular basis of neuronal development. Here we describe the ...

Production of Lentiviral Vectors for Transducing Cells from the Central Nervous System

Efficient gene delivery in the central nervous system (CNS) is important in studying gene functions, modeling neurological diseases and developing ...

Labeling of Single Cells in the Central Nervous System of Drosophila melanogaster

Labeling of Single Cells in the Central Nervous System of Drosophila melanogaster

In this  article we describe how to individually label neurons in the embryonic CNS of Drosophila melanogaster by juxtacellular injection of the ...

Immunohistochemical Analysis in the Rat Central Nervous System and Peripheral Lymph Node Tissue Sections

Immunohistochemistry (IHC) provides highly specific, reliable and attractive protein visualization. Correct performance and interpretation of an IHC-based ...

Neural Circuit Recording from an Intact Cockroach Nervous System

The cockroach ventral nerve cord preparation is a tractable system for neuroethology experiments, neural network modeling, and testing the physiological ...

In vivo Optogenetic Stimulation of the Rodent Central Nervous System

In vivo Optogenetic Stimulation of the Rodent Central Nervous System

The ability to probe defined neural circuits in awake, freely-moving animals with cell-type specificity, spatial precision, and high temporal resolution ...

Using Insect Electroantennogram Sensors on Autonomous Robots for Olfactory Searches

Robots designed to track chemical leaks in hazardous industrial facilities1 or explosive traces in landmine fields2 face the same problem as insects ...

In Situ Ca2+ Imaging of the Enteric Nervous System

In Situ Ca2+ Imaging of the Enteric Nervous System

Reflex behaviors of the intestine are controlled by the enteric nervous system (ENS). The ENS is an integrative network of neurons and glia in two ...

Generation of 3-D Collagen-based Hydrogels to Analyze Axonal Growth and Behavior During Nervous System Development

This protocol uses natural type I collagen to generate three-dimensional (3-D) hydrogel for monitoring and analyzing the axonal growth. The protocol is ...

Transplantation of Chemogenetically Engineered Cortical Interneuron Progenitors into Early Postnatal Mouse Brains

Neuronal development is regulated by a complex combination of environmental and genetic factors. Assessing the relative contribution of each component is ...