Name: closed-loop neuro-robotic experiments to test computational properties of neuronal networks
Uploaded: 2015-03-02T14:00:00
Duration: 11 min 18 s
Description: Watch this Scientific Journal Video about Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks at JoVE.com

The authors wish to thanks Ph.D. student Marta Bisio for culturing and maintaining neuronal networks over Micro-Electrode Arrays and Dr. Marina Nanni and Dr. Claudia Chiabrera from NBT-IIT for the technical assistance for the dissection and dissociation procedures. The research leading to these results has received funding from the European Union&#39;s Seventh Framework Programme (ICT-FET FP7/2007-2013, FET Young Explorers scheme) under grant agreement n&#176; 284772 BRAIN BOW (<a href="http://www.brainbowproject.eu">www.brainbowproject.eu</a>). The authors would also like to thank Silvia Chiappalone for her help in producing the graphics used in the introduction.

1. Preparation of Neuronal Culture over a MEA
<ol>
	<li>Plate neuronal cultures on MEA chips, as described 29. The description of a similar procedure is also provided 9 and in the Discussion section.</li>
	<li>Turn the MEA heating system on 5-10 min before starting the recording to minimize the thermal stress experienced by the cells: set temperature target of the temperature controller to 37 &#176;C and switch on the heating plate below the MEA itself (provided in most commercial MEA systems) and, if available, a heated cover in order to significantly reduce evaporation.</li>
	<li>Sterilize gas-permeable caps before each use in an autoclave with humid-heat (30 min, 130 &#176;C). To avoid evaporation and prevent changes in osmolarity, keep the cultures covered with caps during recording.</li>
	<li>Place the neuronal culture in the amplifier 30 min before actually starting the recording. 
	NOTE: Simply moving the cultures from the incubator to the amplifier will significantly disrupt spontaneous activity for about half an hour. During this time, culture medium temperature will stabilize.</li>
	<li>If a carbair circuit is available, start circulation of carbair (a mixture of 5% CO2 and 95% O2 + N2) for experiments longer than a couple of hours: cultures will require it in order to maintain both oxygen and pH levels stable.</li>
</ol>
2. Selection of Recording Parameters for MEA Acquisition
<ol>
	<li>Select software filter bandwidth to detect spikes (i.e., Multi-Unit Activity &#8211; MUA) 30: in the RawDataDisplay form mark the &#8216;300 Hz-3 kHz&#8217; checkbox .</li>
	<li>Start the acquisition of data: press the &#8216;Start&#8217; button in the RawDataDisplay form.</li>
	<li>Set Threshold Gain for spike detection in the RawDataDisplay to 7. 
	NOTE: Depending on the desired specificity/selectivity tradeoff and on the adopted detection algorithm, this threshold can be set between 6 and 10 times the computed standard deviation .</li>
	<li>Set Threshold Memory to 2 sec and press the &#8216;Lock&#8217; button when no spiking activity is visible on the display (both commands are in the RawDataDisplay form). Mark the &#8216;Estimate SD from median&#8217; to compute noise standard deviation from the median of the absolute value of the observed signal 31,32, if it is difficult to provide even short time windows without spiking activity. Remove the checkmark from this option after pressing the &#8216;Lock&#8217; button, as the underlying algorithm is computationally intensive and might cause the PC to lag.</li>
	<li>Turn on spike detection routine (&#8216;Spike Detection&#8217; checkbox in the RawDataDisplay form). If spike detection is already running (i.e., the checkbox is already marked), discard spikes detected up to this moment by clicking the &#8216;Reset&#8217; button in the Data Recording form.</li>
</ol>
3. Selection of MEA Electrodes to Stimulate the Neuronal Culture and Response Map Computation
<ol>
	<li>Record spontaneous activity of the neuronal cells cultured over the MEA for 30 min: save data to file by clicking the &#8216;Record&#8217; button, in the &#8216;Spikes&#8217; box of the DataRecording form, after the desired amount of time has elapsed (30 min, in this case).</li>
	<li>Identify the 10 most active channels (i.e., 10 channels with highest spike count), then select those channels in any of the MEA layouts (either in the Coding, Decoding or Connection Map forms) by dragging the mouse cursor over the desired areas. Once the channels are selected, right click anywhere on the MEA layout and select &#8216;Add to left sensory area&#8217; in the pop-up menu: these electrodes will be used to deliver electrical stimulation in step 3.5.</li>
	<li>Verify that stimulator and MEA amplifier are correctly connected: all configurations require two wires per desired stimulation channel, while an extra coaxial cable will be required to carry the synchrony signal (please refer to the manuals of the specifics instruments for connection diagrams). Proceed then to turn the stimulator on.</li>
	<li>Define stimulus parameters in the Connection Map form. All the stimulations delivered to the culture are biphasic square voltage waves. Set half-duration to 300 &#181;sec and amplitude to 1.5 Vpp33 . 
	NOTE: Stimuli large enough to reliably evoke neural responses will very likely compromise the recording of activity from the same sites. In the rest of the paper, electrodes used for stimulation delivery should not be selected for recording any relevant information.</li>
	<li>Record response to stimulation: press the Start button in the ConnectionMap form. A series of 30 stimuli, with an interval of 5 sec is, in turn, automatically delivered from each one of the selected electrodes, while responses are recorded from the remaining 59 electrodes.</li>
	<li>Compute a connection map (i.e., the probability of observing a response from an electrode within a time slot after delivery of stimulus from a different electrode) for each stimulating channel through any math software or SpyCode, an application developed in the past (and freely available upon request) to perform computations on neural data 28.</li>
	<li>From the connection maps, select best electrodes: discard all stimulating electrodes that did not evoke responses (i.e. in the time window following stimulation, firing rates are not significantly higher than during spontaneous firing).
	<ol>
		<li>Select, among the remaining electrodes, the pair with the least overleap in responses. Specifically for each stimulating electrode, compute the average spike count in each recording electrode, then compute the difference between corresponding electrodes for all stimulating electrodes pairs. Select the couple for which the sum of absolute values of response differences over all recording channels is highest.</li>
	</ol>
	</li>
	<li>Select one of these electrodes to code sensory information from the left side of the robot and the other to code readings from the right side: in order to do this, drag the mouse cursor over one electrode, right-click on the MEA layout then select &#8216;Add to left sensory area&#8217; (or &#8216;Add to right sensory area&#8217;).</li>
</ol>
4. Interfacing the Neuronal Culture with the Robot: Selection of Coding and Decoding Schemes
<ol>
	<li>Set &#8216;Coding Type&#8217; in the Coding form to Linear.</li>
	<li>Define minimum and maximum stimulation rates in the Coding form. Use the default range of 0.5-2 Hz.</li>
	<li>Set the &#8216;Jitter&#8217; parameter in the Coding form to 0.</li>
	<li>Set the decoding algorithm parameters in the Decoding Form (weight and extinction coefficient) to 1, for a moderately active culture (~1 spike/sec per channel). Define a new parameter pair if firing rates strongly and constantly deviate from this value. See discussion for the exact function of decoding parameters.</li>
	<li>Set the decoding algorithm burst parameters in the Decoding Form. Set weight to 0 (decay time is then irrelevant), unless distinction between spikes and bursts is the subject of study. 
	NOTE: The values suggested in step 4.4 will produce smooth robot movements and speeds compatible with robot reaction times for moderately active rat primary cultures. The burst parameters have exactly the same function as those described in the step 4.4, but the triggering event is the detection of a burst instead of a spike: the actual speed of each wheel is simply the sum of the contributions of detected spikes and bursts.</li>
</ol>
5. Design of Navigation Arena for the Robot
<ol>
	<li>In the Virtual Arena Designer form, choose between bounded (the boundaries of the arena are visible to the robot and impassable) or boundless (if the robot exits from one side of the arena, it will instantly re-enter from the opposite one) arena and set the arena size in pixels.
	<ol>
		<li>Do not use bounded arenas smaller than 100 x 100 pixels, in order to allow significant movement. Do not use obstacles with a radius smaller than 5 pixels as they can simply fall between the lines of sight of the robot.</li>
		<li>Keep in mind that very large arena sizes might cause computer performance to degrade: if a large arena is required, test software performance with the desired arena before starting hard-to-repeat experiments.</li>
	</ol>
	</li>
	<li>Set robot starting position either manually (click the &#8216;Manual Selection&#8217; button in the Virtual Arena Designer form, then the desired location) or by specifying the coordinates of the robot at experiment start in the &#8216;Robot Starting Position&#8217; fields.</li>
	<li>Add any number of impassable obstacles within the arena. Either place them manually in the arena after clicking the &#8216;Add Obstacle Manually&#8217; button or set number and size range.</li>
	<li>Click the &#8216;Generate Arena&#8217; button to generate the arena with the selected features. No changes will occur until this button is pressed.</li>
	<li>Save the designed arena and load the relative file, before use in an experiment, with the command buttons in the lower part of the Virtual Arena Designer form.</li>
</ol>
6. Selection of MEA Electrodes to Record Neuronal Activity from the Culture
<ol>
	<li>Select as temporary recording electrodes those on which different responses, in step 3.8, have been observed: electrodes that showed larger responses following stimulation from the &#8216;left&#8217; (or &#8216;right&#8217;) electrode will constitute the &#8216;left&#8217; (or &#8216;right&#8217;) recording electrodes. Do not use electrodes that did not show significant responses to either stimulating electrode to control the robot. From the MEA layout pop-up menu, select &#8216;Add to left motor area&#8217; (or &#8216;Add to right motor area&#8217;) to define recording electrodes.</li>
	<li>Select features to record in the Experiment Manager form. At this stage, spikes and stimulation time stamps are the only relevant information.</li>
	<li>Perform a 10 min test drive: start the robot run by clicking the Start Experiment button in the Experiment Manager form, click it again after 10 min have elapsed. 
	NOTE: Once all the parameters have been set (coding and decoding, robot arena, stimulating and recording electrodes, features to record), a file name selection will ask for recorded files name and destination, then the robot will start moving in its arena, following the defined rules. All the selected features are automatically saved in real time.</li>
	<li>Repeat steps 3.6 and 6.1 on data acquired in step 6.3, in order to select recording electrodes from data collected during an actual robot run (see Discussion for the rationale of this two-step approach).</li>
</ol>
7. Performing a Neuro-robotic Experiment
<ol>
	<li>Select in the Experiment Manager form the data to be recorded: mark the Spike, Robot and Stimuli Data checkboxes.</li>
	<li>Launch a pre-learning robot run: click the &#8216;Start Experiment&#8217; button in the Experiment Manager form. Select new file names for data files when prompted. When 30 minutes have elapsed, click the &#8216;Start Experiment&#8217; button again to stop the robot run.</li>
	<li>Switch on the learning protocol (mark the &#8216;Deliver Tetanic Stimulation After Hit&#8217; check box in the Experiment Manager form) and perform the training robot run, of the same length as the pre-training phase (i.e., 30 min). Remember to input different file names when prompted to avoid overwriting data from step 7.2.</li>
	<li>Switch off the learning protocol again (unmark the &#8216;Deliver Tetanic Stimulation After Hit&#8217; check box) and perform the post-learning robot run. Once again, remember to change file names to prevent overwriting.</li>
</ol>
8. Second Response Map Computation
<ol>
	<li>Repeat steps 3.1-3.6. Use data from these recordings to test if any changes have been induced either in the spontaneous or evoked activity patterns by the learning protocol.</li>
</ol>

<ol>
	<li>Fetz, E. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Volitional+control+of+neural+activity:+implications+for+brain&#8211;computer+interfaces.">Volitional control of neural activity: implications for brain&#8211;computer interfaces.</a> The Journal of Physiology. 579 (3), 571-579 (2007).</li><li>Carmena, J. M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Learning+to+control+a+brain&#8211;machine+interface+for+reaching+and+grasping+by+primates.">Learning to control a brain&#8211;machine interface for reaching and grasping by primates.</a> PLoS Biology. 1 (2), e42 (2003).</li><li>Azin, M., Guggenmos, D. J., Barbay, S., Nudo, R. J., Mohseni, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+miniaturized+system+for+spike-triggered+intracortical+microstimulation+in+an+ambulatory+rat.">A miniaturized system for spike-triggered intracortical microstimulation in an ambulatory rat.</a> Biomedical Engineering, IEEE Transactions on. 58 (9), 2589-2597 (2011).</li><li>Angotzi, G. N., Boi, F., Zordan, S., Bonfanti, A., Vato, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+programmable+closed-loop+recording+and+stimulating+wireless+system+for+behaving+small+laboratory+animals.">A programmable closed-loop recording and stimulating wireless system for behaving small laboratory animals.</a> Scientific Reports. 4, (2014).</li><li>Maher, M., Pine, J., Wright, J., Tai, Y. -. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+neurochip:+a+new+multielectrode+device+for+stimulating+and+recording+from+cultured+neurons.">The neurochip: a new multielectrode device for stimulating and recording from cultured neurons.</a> Journal of Neuroscience. 87 (1), 45-56 (1999).</li><li>Olsson, R. H., Buhl, D. L., Sirota, A. M., Buzsaki, G., Wise, K. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Band-tunable+and+multiplexed+integrated+circuits+for+simultaneous+recording+and+stimulation+with+microelectrode+arrays.">Band-tunable and multiplexed integrated circuits for simultaneous recording and stimulation with microelectrode arrays.</a> Biomedical Engineering, IEEE Transactions on. 52 (7), 1303-1311 (2005).</li><li>Zanos, S., Richardson, A. G., Shupe, L., Miles, F. P., Fetz, E. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Neurochip-2:+an+autonomous+head-fixed+computer+for+recording+and+stimulating+in+freely+behaving+monkeys.">The Neurochip-2: an autonomous head-fixed computer for recording and stimulating in freely behaving monkeys.</a> Neural Systems and Rehabilitation Engineering. IEEE Transactions on. 19 (4), 427-435 (2011).</li><li>Reger, B. D., Fleming, K. M., Sanguineti, V., Alford, S., Mussa-Ivaldi, F. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Connecting+brains+to+robots:+an+artificial+body+for+studying+the+computational+properties+of+neural+tissues.">Connecting brains to robots: an artificial body for studying the computational properties of neural tissues.</a> Artificial Life. 6 (4), 307-324 (2000).</li><li>Hales, C. M., Roston, J. D., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=How+to+culture,+record+and+stimulate+neuronal+networks+on+micro-electrode+arrays+(MEAs).">How to culture, record and stimulate neuronal networks on micro-electrode arrays (MEAs).</a> Journal of Visualized Experiments. (39), 2056 (2010).</li><li>Gross, G., Rieske, E., Kreutzberg, G., Meyer, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+new+fixed-array+multi-microelectrode+system+designed+for+long-term+monitoring+of+extracellular+single+unit+neuronal+activity+in+vitro.">A new fixed-array multi-microelectrode system designed for long-term monitoring of extracellular single unit neuronal activity in vitro.</a> Neurosci Lett. 6 (2), 101-105 (1977).</li><li>Potter, S. M., DeMarse, T. B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+new+approach+to+neural+cell+culture+for+long-term+studies.">A new approach to neural cell culture for long-term studies.</a> Journal of Neuroscience Methods. 110 (1), 17-24 (2001).</li><li>le Feber, J., Stegenga, J., Rutten, W. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+effect+of+slow+electrical+stimuli+to+achieve+learning+in+cultured+networks+of+rat+cortical+neurons.">The effect of slow electrical stimuli to achieve learning in cultured networks of rat cortical neurons.</a> PLoS One. 5 (1), e8871 (2010).</li><li>Marom, S., Shahaf, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Development+learning+and+memory+in+large+random+networks+of+cortical+neurons:+lessons+beyond+anatomy.">Development learning and memory in large random networks of cortical neurons: lessons beyond anatomy.</a> Quarterly reviews of biophysics. 35 (1), 63-87 (2002).</li><li>Shahaf, G., Marom, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Learning+in+networks+of+cortical+neurons.">Learning in networks of cortical neurons.</a> The Journal of Neuroscience. 21 (22), 8782-8788 (2001).</li><li>Pelt, J., Vajda, I., Wolters, P. S., Corner, M. A., Ramakers, G. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dynamics+and+plasticity+in+developing+neuronal+networks+in+vitro.">Dynamics and plasticity in developing neuronal networks in vitro.</a> Progress in Brain Research. 147, 171-188 (2005).</li><li>Chiappalone, M., Bove, M., Vato, A., Tedesco, M., Martinoia, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dissociated+cortical+networks+show+spontaneously+correlated+activity+patterns+during+in+vitro+development.">Dissociated cortical networks show spontaneously correlated activity patterns during in vitro development.</a> Brain Research. 1093 (1), 41-53 (2006).</li><li>Tateno, T., Jimbo, Y., Robinson, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Spatio-temporal+cholinergic+modulation+in+cultured+networks+of+rat+cortical+neurons:+spontaneous+activity.">Spatio-temporal cholinergic modulation in cultured networks of rat cortical neurons: spontaneous activity.</a> Neuroscience. 134 (2), 425-437 (2005).</li><li>Masquelier, T., Deco, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Network+bursting+dynamics+in+excitatory+cortical+neuron+cultures+results+from+the+combination+of+different+adaptive+mechanism.">Network bursting dynamics in excitatory cortical neuron cultures results from the combination of different adaptive mechanism.</a> PLoS One. 8 (10), e75824 (2013).</li><li>Wagenaar, D. A., Madhavan, R., Pine, J., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Controlling+bursting+in+cortical+cultures+with+closed-loop+multi-electrode+stimulation.">Controlling bursting in cortical cultures with closed-loop multi-electrode stimulation.</a> The Journal of Neuroscience. 25 (3), 680-688 (2005).</li><li>Martinoia, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Towards+an+embodied+in+vitro+electrophysiology:+the+NeuroBIT+project.">Towards an embodied in vitro electrophysiology: the NeuroBIT project.</a> Neurocomputing. 58-60, 1065-1072 (2004).</li><li>Mussa-Ivaldi, F. A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=New+perspectives+on+the+dialogue+between+brains+and+machines.">New perspectives on the dialogue between brains and machines.</a> Frontiers in Neuroscience. 4 (1), 44 (2010).</li><li>Warwick, K., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Controlling+a+Mobile+Robot+with+a+Biological+Brain.">Controlling a Mobile Robot with a Biological Brain.</a> Defence Science Journal. 60 (1), (2010).</li><li>Kudoh, S. N., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Vitroid&#8211;the+robot+system+with+an+interface+between+a+living+neuronal+network+and+outer+world.">Vitroid&#8211;the robot system with an interface between a living neuronal network and outer world.</a> International Journal of Mechatronics and Manufacturing Systems. 4 (2), 135-149 (2011).</li><li>Jimbo, Y., Tateno, T., Robinson, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Simultaneous+induction+of+pathway-specific+potentiation+and+depression+in+networks+of+cortical+neurons.">Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons.</a> Biophysical Journal. 76 (2), 670-678 (1999).</li><li>Chiappalone, M., Massobrio, P., Martinoia, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Network+plasticity+in+cortical+assemblies.">Network plasticity in cortical assemblies.</a> European Journal of Neuroscience. 28 (1), 221-237 (2008).</li><li>Mulas, M., Massobrio, P., Martinoia, S., Chiappalone, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+simulated+neuro-robotic+environment+for+bi-directional+closed-loop+experiments.">A simulated neuro-robotic environment for bi-directional closed-loop experiments.</a> Paladyn. 1 (3), 179-186 (2010).</li><li>Novellino, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Connecting+neurons+to+a+mobile+robot:+an+in+vitro+bidirectional+neural+interface.">Connecting neurons to a mobile robot: an in vitro bidirectional neural interface.</a> Computational Intelligence and Neuroscience. 2007 (12725), 1-13 (2007).</li><li>Bologna, L. L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Investigating+neuronal+activity+by+SPYCODE+multichannel+data+analyzer.">Investigating neuronal activity by SPYCODE multichannel data analyzer.</a> Neural Networks. 23 (6), 685-697 (2010).</li><li>Frega, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Cortical+cultures+coupled+to+micro-electrode+arrays:+a+novel+approach+to+perform+in+vitro+excitotoxicity+testing.">Cortical cultures coupled to micro-electrode arrays: a novel approach to perform in vitro excitotoxicity testing.</a> Neurotoxicology and Teratology. 34 (1), 116-127 (2012).</li><li>Quian Quiroga, R., Panzeri, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Extracting+information+from+neuronal+populations:+information+theory+and+decoding+approaches.">Extracting information from neuronal populations: information theory and decoding approaches.</a> Nature Reviews Neuroscience. 10 (3), 173-185 (2009).</li><li>Donoho, D. L., Johnstone, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Ideal+spatial+adaptation+by+wavelet+shrinkage.">Ideal spatial adaptation by wavelet shrinkage.</a> Biometrika. 81 (3), 425-455 (1994).</li><li>Martinez, J., Pedreira, C., Ison, M. J., Quian Quiroga, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Realistic+simulation+of+extracellular+recordings.">Realistic simulation of extracellular recordings.</a> Journal of neuroscience methods. 184 (2), 285-293 (2009).</li><li>Wagenaar, D. A., Pine, J., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effective+parameters+for+stimulation+of+dissociated+cultures+using+multi-electrode+arrays.">Effective parameters for stimulation of dissociated cultures using multi-electrode arrays.</a> Journal of Neuroscience Methods. 138 (1-2), 27-37 (2004).</li><li>Tessadori, J., Mulas, M., Martinoia, S., Chiappalone, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Biomedical Robotics and Biomechatronics (BioRob), 2012 4th IEEE RAS &amp; EMBS International Conference on. , 332-337 (2012).</li><li>Tessadori, J., Bisio, M., Martinoia, S., Chiappalone, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Modular+neuronal+assemblies+embodied+in+a+closed-loop+environment:+toward+future+integration+of+brains+and+machines.">Modular neuronal assemblies embodied in a closed-loop environment: toward future integration of brains and machines.</a> Frontiers in Neural Circuits. 6, (2012).</li><li>Tessadori, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Neural+Engineering+(NER).">Neural Engineering (NER).</a> , 899-902 (2013).</li><li>Colombi, I., Mahajani, S., Frega, M., Gasparini, L., Chiappalone, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effects+of+antiepileptic+drugs+on+hippocampal+neurons+coupled+to+micro-electrode+arrays.">Effects of antiepileptic drugs on hippocampal neurons coupled to micro-electrode arrays.</a> Frontiers in Neuroengineering. 6, 10 (2013).</li><li>Gal, A., Marom, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Entrainment+of+the+intrinsic+dynamics+of+single+isolated+neurons+by+natural-like+input.">Entrainment of the intrinsic dynamics of single isolated neurons by natural-like input.</a> Journal of Neuroscience. 33 (18), 7912-7918 (2013).</li><li>Mainen, Z. F., Sejnowski, T. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+of+spike+timing+in+neocortical+neurons.">Reliability of spike timing in neocortical neurons.</a> Science. 268 (5216), 1503-1506 (1995).</li><li>Maccione, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+novel+algorithm+for+precise+identification+of+spikes+in+extracellularly+recorded+neuronal+signals.">A novel algorithm for precise identification of spikes in extracellularly recorded neuronal signals.</a> Journal of neuroscience methods. 177 (1), 241-249 (2009).</li><li>DeMarse, T. B., Wagenaar, D. A., Blau, A. W., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+neurally+controlled+animat:+biological+brains+acting+with+simulated+bodies.">The neurally controlled animat: biological brains acting with simulated bodies.</a> Autonomous Robots. 11 (3), 305-310 (1023).</li><li>Bakkum, D. J., Chao, Z. C., Potter, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Spatio-temporal+electrical+stimuli+shape+behavior+of+an+embodied+cortical+network+in+a+goal-directed+learning+task.">Spatio-temporal electrical stimuli shape behavior of an embodied cortical network in a goal-directed learning task.</a> Journal of Neural Engineering. 5 (3), 310-323 (2008).</li><li>Truccolo, W., Hochberg, L. R., Donoghue, J. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Collective+dynamics+in+huma+and+monkey+sensorimotor+cortex:+predicting+single+neuron+spikes.">Collective dynamics in huma and monkey sensorimotor cortex: predicting single neuron spikes.</a> Nature Neuroscience. 13 (1), 105-111 (2010).</li></ol>

The authors declare they have no competing financial interests.

In this paper a neuro-robotic architecture based on a neural controller (i.e., a network of neurons coming from the cortex or the hippocampus of embryonic rats), bi-directionally connected to a virtual robot, is presented. The robot, which has sensors and wheels, is forced to move in a static arena with obstacles and its task consists of avoiding collisions.
The first and possibly most critical aspect of the described procedure is the preparation of the cultures themselves, as the failure rate will tend to be significant even in the best of technical conditions. A detailed description of culturing techniques is, however, outside of the scope of the present work. As a general guideline, recordings should occur when the network firing rate reaches a stable level, usually after 3 weeks in vitro. A rough indication of healthy cultures is the presence of spontaneous electrophysiological activity in several recording channels (at least 20 channels over 60 available). Such cultures are characterized by a high degree of neuronal inter-connectivity. Under such conditions, neural activity usually becomes strongly synchronized and, at times, it displays epileptiform events, with intense spiking followed by minutes-long silent periods 37. Both of these features present a problem: excessive synchronization will make it impossible to distinguish responses to stimuli from different electrodes, while cultures exhibiting epileptiform activity will respond to the first stimulus presented with a long outburst of activity, followed by a silent period, regardless of any successive stimuli delivered. Both these issues can be strongly ameliorated by the employment of patterned cultures 35, in which the neural population is split into two or more weakly interconnected sub-groups.
Another issue is that neural responses strongly depend on the distribution of incoming stimuli 38,39. In a closed-loop experiment, the delivered stimulation is a function of the sensor readings, which, in turn, are a consequence of the robot movement and therefore of the neural responses themselves. This implies that there is no easy way of establishing beforehand what responses will be observed during the actual experiment. As a result, the selection of input-output electrodes must rely on successive approximations. In the described protocol, a two-step process (namely, steps 5.5 and 6.4) is implemented to try to determine a connection map. In the first step, a regular sequence of stimulations is delivered and responses to such stimuli are used to derive a first connection map and a temporary set of recording channels. This configuration is then used to perform the test drive described in step 6.4 and select the recording channels that will be monitored during the actual experiment.
In the Results section, a representative navigation result and the immediate improvements brought about by the introduction of a learning paradigm are presented. Throughout the protocol description, several other possible experimental variants are mentioned. For instance, the two major coding systems implemented in HyBrainWare2 (linear and stochastic) where developed to investigate the exact role of temporal input variability on the neural code 38. In the linear case, instantaneous stimulation rate is a function of user-defined parameters and robot sensors recordings. In the stochastic case, each time instance has a given probability to be chosen to deliver a stimulus. Such probability is automatically computed by HyBrainWare2 so that the expected stimulation rates match that of the former case. The possibility to add jitter to linear coding provides a smooth transition between the two cases described above. In the same way, exploring different combinations of parameters in the decoding section might help shed light on the precise role of bursting in in vitro neural networks. The speed of each wheel of the robot increases proportionally to the weight parameter each time an event is detected in the corresponding output area, while the extinction coefficient indicates how much time, in seconds, one of the contributions takes to lose 50% of its value. The decay is a simple exponential. Those variants have already been taken into account into the current design of HyBrainWare2, but many more research possibilities are open if additional modifications in the software or experimental setup can be introduced.
A rather significant limitation of the protocol here described is the requirement of the developed custom software, HyBrainWare2 (freely available upon request to all interested users). This software has been designed for a set of devices (stimulator, acquisition board, MEA amplifier) of a specific model and manufacturer. While it is indeed possible to adapt it to work on different setups, the conversion will take some programming skill. Similarly, the included options cover only a limited set of all the experimental questions that could be investigated through such a setup. For example, the spike detection algorithm implemented in the presented architecture (precise time spike detection40) is completely defined by several hard-coded parameters that need to be changed if the subject of registration is very different from dissociated neural networks (e.g., cardiac cells or slices). Finally, the learning protocol consists of the delivery of a short, high frequency (2 sec of 20 Hz stimulation, each stimulus pulse is the same as those used to code sensory information) stimulation following each obstacle hit. If the robot hits an obstacle with its right side, the tetanic stimulation is delivered to the electrode that usually codes for right side information and the same holds true for left side hits. This protocol is hard-coded and cannot be changed by the user without modifying exiting software.
While the setup presented here is not the first embodied system for hybrid, closed-loop experiments 20,23,27,41,42, the ones designed in the past were focused on a single thesis supported by data from a limited number of analogous preparations. On the other hand, the described setup has been used for a large number of experiments (more than 100 cultures have been recorded since 2012) with preparations differing for modularity and origin, while the experiments themselves addressed different issues (e.g. impact of tetanic stimulation and relevance of bursting, as presented in the results). In the near future, new experimental sessions are foreseen to verify the lasting effects of both tetanic and closed-loop stimulation and the relationship between stimulation regularity and observed responses. Another issue to be addressed is the link between spontaneous and observed activity, with the idea of adding a new decoding algorithm that takes into account the history of past activity and stimulation 43.

Many features of brain function are currently impossible to replicate in an artificial system. The brain&#8217;s ability to quickly process complex sensory information and to generate, in response, precise motor commands is by itself already beyond the current state-of-the-art. But its ability to adapt to different conditions by learning from past experience makes it so vastly superior to human-developed control systems. So far, attempts to replicate or exploit this plasticity have met little success, and the comprehension of the inner workings of the brain has eluded the grasp of researchers. One of the main issues while investigating the relationship between brain and behavior is the inability to properly access all of the variables in the system: ideally, an optimal experimental setup would allow simultaneous recording and stimulation to a large numbers of neurons, long-term stability, monitoring of synapses positions and weights, and controllable bi-directional interaction with the environment. The difficulty in tracking all those variables simultaneously led to the study of the brain-behavior relationship at two very different scales: either with behaving animals, with no fine control over experimental conditions 1-7 or with small, isolated parts, such as portions of neuronal tissue, with no overall view of the system 8. In the latter case, while no devised experimental setup allows the complete monitoring of all the parameters involved in the workings of even a simple neural network, a good trade-off is provided by dissociated neurons grown over Micro-Electrode Arrays (MEAs) 9. Those devices, born at the end of the 70&#39;s 10, have several advantages over traditional electrophysiology techniques: firstly, the possibility of recording and stimulating a neural network in many different locations at once (usually 60 electrodes). Furthermore, the coupling of MEAs with cells is almost non-invasive, allowing the observation of the same network for long periods of time, up to several months 11. The physiological effects of electrical stimulation on dissociated cultures have been extensively studied thanks to those devices, revealing that many properties observed at higher scales (such as, for example, plasticity and simple memory processes 12-14) are conserved despite the loss of architecture. During culture growth, those networks start showing spontaneous activity at about 7 days in vitro (DIV) 15,16. Network activity tends to change radically with further growth; first as single spikes gather into bursts (towards the end of the second week) 17, later as it changes into a highly complex pattern of synchronized, non-periodic network bursts 18, which represents the mature state of a network. It has been suggested 19 that this synchronous behavior, somewhat similar to that observed in in vivo recordings on sleeping animals, is caused by the lack of sensory input.
A different approach attempted to gain a better understanding of information coding has been taken by performing closed-loop experiments, in which different types of signals were used to control the stimulation of the neuronal network itself 11,20-23. In these experiments, an external agent capable of interaction with the environment has been used to generate sensory information fed to the neural network, which, in turn, produced motor commands for an effector mechanism. This allowed observations of how dynamic and adaptive properties of neural systems evolved in response to induced changes in the environment.
A setup to perform &#8216;embodied neurophysiology&#8217; experiments was developed, where a wheeled sensor platform (a physical robot or its virtual model) moves about in an arena and its speed profiles are determined by the activity of a neuronal system (i.e., a population of rat neurons cultured over a MEA). The robot is characterized by the speed profiles of its two independently-controlled wheels and by the current readings of the distance sensors. The exact nature of the distance sensors is not relevant; they may be active or passive optical sensors or ultrasound sensors. Clearly, this issue does not apply in the case of virtual robots, in which sensors may be designed with any desired feature.
In the experiments herein described, the robot used is always the virtual implementation, with 6 distance sensors pointing at 30&#176;, 60&#176; and 90&#176; from the robot heading in both directions. The activity of the three left and right sensors is averaged and the activity of the biological culture is driven by the information collected by such &#8216;super-sensors&#8217; (which will just be referred to as &#8216;left&#8217; and &#8216;right&#8217; sensors in the rest of this work). The protocol described may actually be applied to the physical robot with fairly minor adjustments. The information collected by the robot (either physical or virtual) is encoded in a series of stimuli that are used to manipulate the activity of the biological neural network, which is physically separated by the robot. The stimuli themselves are all identical and thus do not code any information. What is relevant is their frequency: stimulation rate increases when the robot approaches an obstacle, with different delivery sites coding sensory information from the left and right &#8216;eyes&#8217; of the robot. The neural network will present different responses to the incoming train of stimulations: the task of the decoding algorithm is to translate the resulting network activity into commands used to control the wheels of the robot. Given a &#8216;perfect&#8217; network behavior (i.e., with reliable and totally separated responses to stimuli from different electrodes), this would result in the robot driving in its arena without hitting any obstacle. Most networks present a behavior very different from ideality, therefore a simple learning protocol is introduced: when activated, tetanic stimulation (brief spells of high-frequency stimulation, 20 Hz stimulation for 2 sec, inspired by protocols described in 24,25) following a collision with an obstacle is delivered. If the tetanic stimulation results in a local strengthening of network connectivity, this will result in a progressive increase in the navigational capabilities of the robot.
HyBrainWare2, an improved version of the custom software published in 26, is the core architecture developed to handle the control of the different devices of the system (stimulator, data acquisition, processing and visualization, robot communication or simulation). This software has been developed at our lab and is freely available on request. This software provides the interface with the data acquisition board: once the user starts data acquisition from the GUI, the software controls the acquisition board to start the sampling and A/D conversion of data coming from the recording electrodes. This data can then be recorded, displayed to screen or analyzed in real-time to detect spikes, according to the options set by the user (see Procedure section for details). Furthermore, within the software, the definition of coding (translation of sensory information into an electrical stimulation) and decoding (translation of recorded activity into motor commands for the robot) algorithms must be specified. In particular, our setup is relatively user-friendly compared to similar systems designed in the past 27, since almost all variables can be accessed by the user right before starting the actual experiment, while all the recorded information is automatically saved in a format compatible with a neural data analysis toolbox 28.
The following Procedure section describes a learning experiment on dissociated rat hippocampal cultures: all the culturing and experimental parameters are provided for this particular preparation and may need to be modified if a different biological substrate is to be used. Similarly, the described experiment takes advantage of the closed-loop architecture to investigate the learning effect of tetanic stimulation, but the architecture itself is flexible enough to be used in the study of different features of dissociated neural networks. Major variants of the proposed experiment are further explained in the Discussion section.

<table border="0" cellpadding="0" cellspacing="0" width="476">
	<tbody>
		<tr height="21">
			<td height="21" style="height:21px;width:247px;">Name of Reagent/Material</td>
			<td style="width:229px;">Company</td>
		</tr>
		<tr height="22">
			<td height="22" style="height:22px;width:247px;">Stimulus Generator 4002</td>
			<td style="width:229px;">Multi Channel Systems</td>
		</tr>
		<tr height="22">
			<td height="22" style="height:22px;width:247px;">MEA1060-Inv-BC</td>
			<td style="width:229px;">Multi Channel Systems</td>
		</tr>
		<tr height="22">
			<td height="22" style="height:22px;width:247px;">TC02</td>
			<td style="width:229px;">Multi Channel Systems</td>
		</tr>
		<tr height="22">
			<td height="22" style="height:22px;width:247px;">NI 6255 Acquisition Card</td>
			<td style="width:229px;">National Instruments</td>
		</tr>
		<tr height="22">
			<td height="22" style="height:22px;width:247px;">Microsoft Visual Studio 2008</td>
			<td style="width:229px;">Microsoft</td>
		</tr>
		<tr height="42">
			<td height="42" style="height:42px;width:247px;">2078P Multichannel System-National Instruments adapter board</td>
			<td style="width:229px;">Developed at University of Genova (Italy)</td>
		</tr>
		<tr height="22">
			<td height="22" style="height:22px;width:247px;">Matlab 2010</td>
			<td style="width:229px;">Mathworks</td>
		</tr>
	</tbody>
</table>

closed-loop neuro-robotic experiments to test computational properties of neuronal networks

Information coding in the Central Nervous System (CNS) remains unexplored. There is mounting evidence that, even at a very low level, the representation of a given stimulus might be dependent on context and history. If this is actually the case, bi-directional interactions between the brain (or if need be a reduced model of it) and sensory-motor system can shed a light on how encoding and decoding of information is performed. Here an experimental system is introduced and described in which the activity of a neuronal element (i.e., a network of neurons extracted from embryonic mammalian hippocampi) is given context and used to control the movement of an artificial agent, while environmental information is fed back to the culture as a sequence of electrical stimuli. This architecture allows a quick selection of diverse encoding, decoding, and learning algorithms to test different hypotheses on the computational properties of neuronal networks.

The developed experimental framework allowed the testing of whether an exchange of information between a culture of neurons and the virtual realization of a physical robot is possible 34. Figure 1 shows several samples of obtained paths travelled by a virtual robot in 20 min experiments in different conditions: from left to right a proper closed-loop experiment, an &#8216;empty MEA&#8217; robot experiment (no cells are plated on the MEA for this control experiment) and a open-loop robot experiment (stimulation rate is constant instead of coding sensor information) are represented. The representative traces confirm that a bi-directional interaction between the neuronal and artificial elements is necessary in order to obtain good navigation performances of the robot. Nevertheless, the robot experiences several hits against the obstacles.
In Figure 2, the navigation performance of the robot, expressed as pixels travelled between subsequent hits, is shown in different conditions. The first two columns display the distribution of distances travelled in the control experiments mentioned above (&#8216;empty MEA&#8217; and open-loop configurations), while the third and fourth columns display the performance without and with, respectively, the delivery of tetanic stimulation following each hit against an obstacle. The introduction of the tetanic stimulation (Cf. Procedure, point 7.2) improves significantly the distance travelled between two consecutive hits, thus improving the navigation performances of the robot 35.
In Figure 3, the navigation performance of a robot with different decoding conditions is presented. To this end, a different arena configuration has been adopted. This helped to quantify the successful navigation of the robot within the arena 36: as described in step 4.1 of the procedure, the robot is presented a series of short tracks. The success rate is simply the ratio of the number of successfully crossed tracks over the number of presented tracks. In particular, during the experiments a real-time identification of burst and isolated spikes was performed. The decoding paradigms differ from one another because of the relative weights of bursts and isolated spikes (Cf. Procedure, points 3.5-3.6 and Discussion).
<img alt="Figure 1" src="/files/ftp_upload/52341/52341fig1highres.jpg" width="700" /> 
Figure 1: A neuronal network and a robot have a bi-directional exchange of information. This figure shows three representative paths travelled by the robot over 20 minutes of experiment. In particular, light green areas are free for the robot to move in, whereas dark green pixels represent impassable obstacles that the robot can perceive through its distance sensors. In each trial, the robot starts in the upper left section of the arena and travels to its final position, depicted as a large pink dot. The smaller black dots represent hits against an obstacle, while the color-coded path provides an indication of the time evolution of robot movement. The color bar on the right expresses time elapsed from the beginning of the experiment in minutes. (A) Path followed during a closed-loop experiment. (B) Path followed during an &#8216;empty&#8217; MEA experiment (no cells are cultured on the MEA surface). (C) Path followed during an open-loop experiment (stimulation rate is constant throughout the experiment). <a href="/files/ftp_upload/52341/52341fig1highres.jpg" target="_blank">Please click here to view a larger version of the figure.</a>
<img alt="Figure 2" src="/files/ftp_upload/52341/52341fig2.jpg" /> 
Figure 2: Performance results are affected by closed-loop and tetanic stimulation. This graph reports the distributions of distances covered by the robot between subsequent hits in different conditions. In particular, the first two distributions represent control experiments (&#8216;Empty&#8217; for recordings with no neurons plated on the MEA, &#8216;Open loop&#8217; (OL) for experiment with a &#8216;blind&#8217; robot). The last two columns represent the &#8216;Closed loop&#8217; condition without (CL) and with (CL + TS) the learning protocol implemented through Tetanic Stimulation (TS), being delivered to the culture following hits against an obstacle. In each box, the central horizontal segment represents the median of the distribution, the empty square the mean value, the central bar extends to the first and third quartile and the whiskers extend to the 5th and 95th percentiles. Outliers are represented as diamonds. Statistics have been performed using the Kruskall-Wallis one way analysis of variance on ranks: the Student-Newman-Keuls pairwise comparison reveals that all median values are significantly different with p &#60; 0.05.
<img alt="Figure 3" src="/files/ftp_upload/52341/52341fig3.jpg" /> 
Figure 3: Decoding influences robotic performance. The graph above represents the probability, for a given decoding algorithm, of the robot to navigate successfully through a short track in a limited amount of time. Identification of bursts and isolated spikes is performed in real time during the experiment itself. In the first case (&#8216;Spikes&#8217;) all detected spikes present the same relative weight, for the second and third distributions a weight of 0 was set for, respectively, isolated spikes and spikes belonging to a burst. The last two columns represent the results obtained in the case where all the spikes are accounted for, but with a different relative weight according to their position. In particular in the fourth column isolated spikes were given higher relative weight than burst events, while the weighting is inverted for the decoding relative to the fifth column data. In each graph, the central line represents the median of the distribution, the empty square the mean value, while the central bar extends to the first and third quartile and the whiskers extend to the 5th and 95th percentiles. Statistics have been performed using the Kruskall-Wallis one way analysis of variance on ranks. The pairwise comparison (Student-Newman-Keuls method,) reveals that significant differences (p &#60;0.05) can be observed between columns 1 and 4, 2 and 4, 2 and 5, 2 and 3.

Watch this Scientific Journal Video about Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks at JoVE.com

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

In this paper, an experimental framework to perform closed-loop experiments is presented, in which information processing (i.e., coding and decoding) and learning of neuronal assemblies are studied during the continuous interaction with a robotic body.

Information coding in the Central Nervous System (CNS) remains unexplored. There is mounting evidence that, even at a very low level, the representation ...

closed-loop-neuro-robotic-experiments-to-test-computational

Research

JoVE Journal

Neuroscience

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

The non-stationary nature and variability of neuronal signals is a fundamental problem in brain-machine interfacing. We developed a brain-machine interface to assess the robustness of different control-laws applied to a closed-loop image stabilization task. Taking advantage of the well-characterized fly visuomotor pathway we record the electrical activity from an identified, motion-sensitive neuron, H1, to control the yaw rotation of a two-wheeled robot. The robot is equipped with 2 high-speed video cameras providing visual motion input to a fly placed in front of 2 CRT computer monitors. The activity of the H1 neuron indicates the direction and relative speed of the robot's rotation. The neural activity is filtered and fed back into the steering system of the robot by means of proportional and proportional/adaptive control. Our goal is to test and optimize the performance of various control laws under closed-loop conditions for a broader application also in other brain machine interfaces.

We use a closed-loop fly-machine interface to investigate general principles in neuronal control.

The non-stationary nature and variability of neuronal signals is a fundamental problem in brain-machine interfacing. We developed a brain-machine ...

Fast Micro-iontophoresis of Glutamate and GABA: A Useful Tool to Investigate Synaptic Integration

One of the fundamental interests in neuroscience is to understand the integration of excitatory and inhibitory inputs along the very complex structure of the dendritic tree, which eventually leads to neuronal output of action potentials at the axon. The influence of diverse spatial and temporal parameters of specific synaptic input on neuronal output is currently under investigation, e.g. the distance-dependent attenuation of dendritic inputs, the location-dependent interaction of spatially segregated inputs, the influence of GABAergig inhibition on excitatory integration, linear and non-linear integration modes, and many more.
With fast micro-iontophoresis of glutamate and GABA it is possible to precisely investigate the spatial and temporal integration of glutamatergic excitation and GABAergic inhibition. Critical technical requirements are either a triggered fluorescent lamp, light-emitting diode (LED), or a two-photon scanning microscope to visualize dendritic branches without introducing significant photo-damage of the tissue. Furthermore, it is very important to have a micro-iontophoresis amplifier that allows for fast capacitance compensation of high resistance pipettes. Another crucial point is that no transmitter is involuntarily released by the pipette during the experiment.
Once established, this technique will give reliable and reproducible signals with a high neurotransmitter and location specificity. Compared to glutamate and GABA uncaging, fast iontophoresis allows using both transmitters at the same time but at very distant locations without limitation to the field of view. There are also advantages compared to focal electrical stimulation of axons: with micro-iontophoresis the location of the input site is definitely known and it is sure that only the neurotransmitter of interest is released. However it has to be considered that with micro-iontophoresis only the postsynapse is activated and presynaptic aspects of neurotransmitter release are not resolved. In this article we demonstrate how to set up micro-iontophoresis in brain slice experiments.

In this article we introduce fast micro-iontophoresis of neurotransmitters as a technique to investigate integration of postsynaptic signals with high spatial and temporal precision.

One of the fundamental interests in neuroscience is to understand the integration of excitatory and inhibitory inputs along the very complex structure of ...

A Procedure for Implanting Organized Arrays of Microwires for Single-unit Recordings in Awake, Behaving Animals

In vivo electrophysiological recordings in the awake, behaving animal provide a powerful method for understanding neural signaling at the single-cell level. The technique allows experimenters to examine temporally and regionally specific firing patterns in order to correlate recorded action potentials with ongoing behavior. Moreover, single-unit recordings can be combined with a plethora of other techniques in order to produce comprehensive explanations of neural function. In this article, we describe the anesthesia and preparation for microwire implantation. Subsequently, we enumerate the necessary equipment and surgical steps to accurately insert a microwire array into a target structure. Lastly, we briefly describe the equipment used to record from each individual electrode in the array. The fixed microwire arrays described are well-suited for chronic implantation and allow for longitudinal recordings of neural data in almost any behavioral preparation. We discuss tracing electrode tracks to triangulate microwire positions as well as ways to combine microwire implantation with immunohistochemical techniques in order to increase the anatomical specificity of recorded results.

Implanting organized arrays of microwires for use in single-unit electrophysiological recordings presents a number of technical challenges.&#160;Methods for performing this technique and the equipment necessary are described.&#160;Also, the beneficial use of organized microwire arrays to record from distinct neural subregions with high spatial selectivity is discussed.

In vivo electrophysiological recordings in the awake, behaving animal provide a powerful method for understanding neural signaling at the single-cell ...

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Experimental neuroscience is witnessing an increased interest in the development and application of novel and often complex, closed-loop protocols, where the stimulus applied depends in real-time on the response of the system. Recent applications range from the implementation of virtual reality systems for studying motor responses both in mice1 and in zebrafish2, to control of seizures following cortical stroke using optogenetics3. A key advantage of closed-loop techniques resides in the capability of probing higher dimensional properties that are not directly accessible or that depend on multiple variables, such as neuronal excitability4 and reliability, while at the same time maximizing the experimental throughput. In this contribution and in the context of cellular electrophysiology, we describe how to apply a variety of closed-loop protocols to the study of the response properties of pyramidal cortical neurons, recorded intracellularly with the patch clamp technique in acute brain slices from the somatosensory cortex of juvenile rats. As no commercially available or open source software provides all the features required for efficiently performing the experiments described here, a new software toolbox called LCG5 was developed, whose modular structure maximizes reuse of computer code and facilitates the implementation of novel experimental paradigms. Stimulation waveforms are specified using a compact meta-description and full experimental protocols are described in text-based configuration files. Additionally, LCG has a command-line interface that is suited for repetition of trials and automation of experimental protocols.

Closed-loop protocols are becoming increasingly widespread in modern day electrophysiology. We present a simple, versatile and inexpensive way to perform complex electrophysiological protocols in cortical pyramidal neurons in vitro, using a desktop computer and a digital acquisition board.

Experimental neuroscience is witnessing an increased interest in the development and application of novel and often complex, closed-loop protocols, where ...

Design, Surface Treatment, Cellular Plating, and Culturing of Modular Neuronal Networks Composed of Functionally Inter-connected Circuits

The brain operates through the coordinated activation and the dynamic communication of neuronal assemblies. A major open question is how a vast repertoire of dynamical motifs, which underlie most diverse brain functions, can emerge out of a fixed topological and modular organization of brain circuits. Compared to in vivo studies of neuronal circuits which present intrinsic experimental difficulties, in vitro preparations offer a much larger possibility to manipulate and probe the structural, dynamical and chemical properties of experimental neuronal systems. This work describes an in vitro experimental methodology which allows growing of modular networks composed by spatially distinct, functionally interconnected neuronal assemblies. The protocol allows controlling the two-dimensional (2D) architecture of the neuronal network at different levels of topological complexity.
A desired network patterning can be achieved both on regular cover slips and substrate embedded micro electrode arrays. Micromachined structures are embossed on a silicon wafer and used to create biocompatible polymeric stencils, which incorporate the negative features of the desired network architecture. The stencils are placed on the culturing substrates during the surface coating procedure with a molecular layer for promoting cellular adhesion. After removal of the stencils, neurons are plated and they spontaneously redirected to the coated areas. By decreasing the inter-compartment distance, it is possible to obtain either isolated or interconnected neuronal circuits. To promote cell survival, cells are co-cultured with a supporting neuronal network which is located at the periphery of the culture dish. Electrophysiological and optical recordings of the activity of modular networks obtained respectively by using substrate embedded micro electrode arrays and calcium imaging are presented. While each module shows spontaneous global synchronizations, the occurrence of inter-module synchronization is regulated by the density of connection among the circuits.

This manuscript describes a protocol to grow in vitro modular networks consisting of spatially confined, functionally inter-connected neuronal circuits. A polymeric mask is used to pattern a protein layer to promote cellular adhesion over the culturing substrate. Plated neurons grow on coated areas establishing spontaneous connections and exhibiting electrophysiological activity.

The brain operates through the coordinated activation and the dynamic communication of neuronal assemblies. A major open question is how a vast repertoire ...

Chronic Transcranial Electrical Stimulation and Intracortical Recording in Rats

Transcranial electrical stimulation (TES) is a powerful and relatively simple approach to diffusely influence brain activity either randomly or in a closed-loop event-triggered manner. Although many studies are focusing on the possible benefits and side-effects of TES in healthy and pathologic brains, there are still many fundamental open questions regarding the mechanism of action of the stimulation. Therefore, there is a clear need for a robust and reproducible method to test the acute and the chronic effects of TES in rodents. TES can be combined with regular behavioral, electrophysiological, and imaging techniques to investigate neuronal networks in vivo. The implantation of transcranial stimulation electrodes does not impose extra constraints on the experimental design while it offers a versatile, flexible tool to manipulate brain activity. Here we provide a detailed, step-by-step protocol to fabricate and implant transcranial stimulation electrodes to influence brain activity in a temporally constrained manner for months.

This detailed protocol describes transcranial stimulation electrode placement on the temporal bone in order to investigate the short- and long-term effects of transcranial electrical stimulation in freely moving rats.

Transcranial electrical stimulation (TES) is a powerful and relatively simple approach to diffusely influence brain activity either randomly or in a ...

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments

Closed-loop neurophysiological systems use patterns of neuronal activity to trigger stimuli, which in turn affect brain activity. Such closed-loop systems are already found in clinical applications, and are important tools for basic brain research. A particularly interesting recent development is the integration of closed-loop approaches with optogenetics, such that specific patterns of neuronal activity can trigger optical stimulation of selected neuronal groups. However, setting up an electrophysiological system for closed-loop experiments can be difficult. Here, a ready-to-apply Matlab code is provided for triggering stimuli based on the activity of single or multiple neurons. This sample code can be easily modified based on individual needs. For instance, it shows how to trigger sound stimuli and how to change it to trigger an external device connected to a PC serial port. The presented protocol is designed to work with a popular neuronal recording system for animal studies (Neuralynx). The implementation of closed-loop stimulation is demonstrated in an awake rat.

This protocol demonstrates how to use an electrophysiological system for closed-loop stimulation triggered by neuronal activity patterns. Sample Matlab code that can be easily modified for different stimulation devices is also provided.

Closed-loop neurophysiological systems use patterns of neuronal activity to trigger stimuli, which in turn affect brain activity. Such closed-loop systems ...

In vivo Calcium Imaging in Mouse Inferior Olive

Inferior olive (IO), a nucleus in the ventral medulla, is the only source of climbing fibers that form one of the two input pathways entering the cerebellum. IO has long been proposed to be crucial for motor control and its activity is currently considered to be at the center of many hypotheses of both motor and cognitive functions of the cerebellum. While its physiology and function have been relatively well studied on single-cell level in vitro, presently there are no reports on the organization of the IO network activity in living animals. This is largely due to the extremely challenging anatomical location of the IO, making it difficult to subject to conventional fluorescent imaging methods, where an optic path must be created through the entire brain located dorsally to the region of interest.
Here we describe an alternative method for obtaining state-of-the-art -level calcium imaging data from the IO network. The method takes advantage of the extreme ventral location of the IO and involves a surgical procedure for inserting a gradient-refractive index (GRIN) lens through the neck viscera to come into contact with the ventral surface of the calcium sensor GCaMP6s-expressing IO in anesthetized mice. A representative calcium imaging recording is shown to demonstrate the feasibility to record IO neuron activity after the surgery. While this is a non-survival surgery and the recordings must be conducted under anesthesia, it avoids damage to life-critical brainstem nuclei and allows conducting large variety of experiments investigating spatiotemporal activity patterns and input integration in the IO. This procedure with modifications could be used for recordings in other, adjacent regions of the ventral brainstem.

In vivo Calcium Imaging in Mouse Inferior Olive

We present a protocol to expose the brainstem of adult mouse from the ventral side. By using a gradient-refractive index lens with a miniature microscope, calcium imaging can be used to examine the activity of inferior olive neural somata in vivo.

Inferior olive (IO), a nucleus in the ventral medulla, is the only source of climbing fibers that form one of the two input pathways entering the ...

In Vivo Calcium Imaging of Neuronal Ensembles in Networks of Primary Sensory Neurons in Intact Dorsal Root Ganglia

Ca2+ imaging can be used as a proxy for cellular activity, including action potentials and various signaling mechanisms involving Ca2+ entry into the cytoplasm or the release of intracellular Ca2+ stores. Pirt-GCaMP3-based Ca2+ imaging of primary sensory neurons of the dorsal root ganglion (DRG) in mice offers the advantage of simultaneous measurement of a large number of cells. Up to 1,800 neurons can be monitored, allowing neuronal networks and somatosensory processes to be studied as an ensemble in their normal physiological context at a populational level in vivo. The large number of neurons monitored allows the detection of activity patterns that would be challenging to detect using other methods. Stimuli can be applied to the mouse hindpaw, allowing the direct effects of stimuli on the DRG neuron ensemble to be studied. The number of neurons producing Ca2+ transients as well as the amplitude of Ca2+ transients indicates sensitivity to specific sensory modalities. The diameter of neurons provides evidence of activated fiber types (non-noxious mechano vs. noxious pain fibers, A&#946;, A&#948;, and C fibers). Neurons expressing specific receptors can be genetically labeled with td-Tomato and specific Cre recombinases together with Pirt-GCaMP. Therefore, Pirt-GCaMP3 Ca2+ imaging of DRG provides a powerful tool and model for the analysis of specific sensory modalities and neuron subtypes acting as an ensemble at the populational level to study pain, itch, touch, and other somatosensory signals.

In Vivo Calcium Imaging of Neuronal Ensembles in Networks of Primary Sensory Neurons in Intact Dorsal Root Ganglia

This protocol describes the surgical exposure of the dorsal root ganglion (DRG) followed by GCaMP3 (genetically-encoded Ca2+ indicator; Green Fluorescent Protein-Calmodulin-M13 Protein 3) Ca2+ imaging of the neuronal ensembles using Pirt-GCaMP3 mice while applying a variety of stimuli to the ipsilateral hind paw.

Ca2+ imaging can be used as a proxy for cellular activity, including action potentials and various signaling mechanisms involving Ca2+ entry into the ...

Open-Source Real-Time Closed-Loop Electrical Threshold Tracking for Translational Pain Research

Nociceptors are a class of primary afferent neurons that signal potentially harmful noxious stimuli. An increase in nociceptor excitability occurs in acute and chronic pain conditions. This produces abnormal ongoing activity or reduced activation thresholds to noxious stimuli. Identifying the cause of this increased excitability is required for the development and validation of mechanism-based treatments. Single-neuron electrical threshold tracking can quantify nociceptor excitability. Therefore, we have developed an application to allow such measurements and demonstrate its use in humans and rodents. APTrack provides real-time data visualization and action potential identification using a temporal raster plot. Algorithms detect action potentials by threshold crossing and monitor their latency after electrical stimulation. The plugin then modulates the electrical stimulation amplitude using an up-down method to estimate the electrical threshold of the nociceptors. The software was built upon the Open Ephys system (V0.54) and coded in C++ using the JUCE framework. It runs on Windows, Linux, and Mac operating systems. The open-source code is available (<a data-saferedirecturl="https://www.google.com/url?q=https://github.com/Microneurography/APTrack&amp;source=gmail&amp;ust=1680789829274000&amp;usg=AOvVaw0nMk9J_EI2jUn8SlmC5JJm" href="https://github.com/Microneurography/APTrack" target="_blank">https://github.com/Microneurography/APTrack</a>). The electrophysiological recordings were taken from nociceptors in both a mouse skin-nerve preparation using the teased fiber method in the saphenous nerve and in healthy human volunteers using microneurography in the superficial peroneal nerve. Nociceptors were classified by their response to thermal and mechanical stimuli, as well as by monitoring the activity-dependent slowing of the conduction velocity. The software facilitated the experiment by simplifying the action potential identification through the temporal raster plot. We demonstrate real-time closed-loop electrical threshold tracking of single-neuron action potentials during&#160;in vivo&#160;human microneurography, for the first time, and during&#160;ex vivo&#160;mouse electrophysiological recordings of C-fibers and A&#948;-fibers. We establish proof of principle by showing that the electrical threshold of a human heat-sensitive C-fiber nociceptor is reduced by heating the receptive field. This plugin enables the electrical threshold tracking of single-neuron action potentials and allows the quantification of changes in nociceptor excitability.

APTrack is a software plugin developed for the Open Ephys platform that enables real-time data visualization and the closed-loop electrical threshold tracking of neuronal action potentials. We have successfully used this in microneurography for human C-fiber nociceptors and mouse C-fiber and A&#948;-fiber nociceptors.

Nociceptors are a class of primary afferent neurons that signal potentially harmful noxious stimuli. An increase in nociceptor excitability occurs in ...