We would like to thank Dr. Matthew F S Rushworth (Department of Experimental Psychology, University of Oxford) and Dr. Sakagami Masamichi (Brain Science Research Center, Tamagawa University) for their valuable advice on initiation of the project and on the details of the protocols. We thank Dr. Lily Yu for critical comments and editing the manuscript. This project was supported by the RIKEN Incentive Research Project (100226201701100443) to Q.Z, the Brain Science Project, Center for novel science initiatives, National institutes of natural sciences (BS291003) to Q.Z, the RIKEN Aging Project (10026-201701100263-340120) to Q.Z and the JSPS Kakenhi Grant-in-Aid for Young Scientists (B) (17841749) to Q.Z.
Authors contributions: Q.Z conceived and initiated the project, Q.Z, Y.K and H.G performed the experiments and data analysis, H.G coordinated the work between the lab and O&#39;HARA &#38; Co., Ltd., Q.Z and Y.K wrote the manuscript, S.I supervised the project.

All experimental protocols were approved by the Animal Care and Use Committees of the RIKEN Brain Science Institute.
1. Animal Preparation
<ol>
	<li>Choose the sex, age, genotype and pharmacological treatments of experimental mice (or rats) depending on the experimental purpose. 
	NOTE: Here we demonstrated the performance of four male C57B/6 mice of 2 months old.</li>
	<li>House the mice in a room maintained under standard conditions (12 h light/12 h dark cycle, lights on between 8:00 A.M. and 8:00 P.M., 22 &#177; 1&#176;C). 
	NOTE: If the purpose is to compare the difference between two genotypes, group 4 mice per cage and include 2 mice of each genotype.</li>
	<li>Handle the mice for 2 min/day for 5 days to familiarize them with human contact. Feed them with measured rations so that their body weight is roughly maintained about 80&#8211;85% of the free feeding weight throughout the experiment. Provide water ad libitum.</li>
	<li>Habituate mice to the experimental room by transferring all mice from the mouse housing room to the experimental room 30 min before the experiment each day.</li>
	<li>Start experiments at the same time each day to avoid the effects of circadian rhythms on animal performance.</li>
</ol>
2. Animal Habituation to the Maze
<ol>
	<li>Start habituation to the maze simultaneously with mouse handling (2 min/day). Keep all doors open at this stage. Perform habituation for a total of 5 days.</li>
	<li>On day 1, scatter the food pellets throughout the maze.</li>
	<li>On days 2 and 3, scatter the pellets along the two goal arms.</li>
	<li>On days 4 and 5, put the pellets only at the two goal boxes.</li>
	<li>Everyday, after placing the pellets, place the mice in the start box of the T-maze in groups of four and allow the mice to explore the maze for 10 min. 
	NOTE: Habituating the mice in groups of four will help them to learn from each other and speed up training.</li>
</ol>
3. Animal Discrimination of HRA from LRA
NOTE: This protocol includes both delay-based and effort-based decision-making tests. However, depending on the purpose, researchers can test only one of them, or both. Control software (Table of Material) is used to automatically control the T-maze setup for the following steps. If effort-based decision making will be tested, introduce barriers to both HRA and LRA in the forced arm entry phase. Then animals will be trained for both discrimination and barrier climbing simultaneously. The starving mice actively climb the barriers and after this phase, all of them can climb skillfully. Therefore, it is not necessary to start from a lower barrier with this protocol.
<ol>
	<li>Forced arm entry phase
	<ol>
		<li>Open the parameter registration window of&#160;the control software and set up parameters as follows (Figure 3).
		<ol>
			<li>Choose the &#34;phase option&#34;. Set&#160;the &#34;trial number&#34; to 10, so that each animal will go through 10 trials per day for&#160;5 continuous days. 
			Note: One can choose a different trial&#160;number&#160;in his/her own&#160;experiments.</li>
			<li>Set the &#34;Duration&#34; to 900 s so that the training of one mouse per day will not exceed 900 s. Set the &#34;Default start delay time&#34; to 3 s, so that the start door will open 3 s after the animal is detected in the start area.&#160;</li>
			<li>Set the &#34;pellet number&#34; for the HRA and the LRA so that 4 pellets are always automatically dispensed in the HRA and 1 pellet is dispensed in the LRA. 
			Note: In our experiments, we&#160;found that 1:4 is the best ratio when 10 mg sugar pellets are used. If we use&#160;6 to 10 pellets, the mice cannot finish eating all of them and there will be omission happening.</li>
			<li>Set the &#34;Delay time&#34; to 0 s, so that there will be no delay for both HRA and LRA during this phase.</li>
		</ol>
		</li>
		<li>Open the &#34;ID registration&#34; window of control software. Register&#160;ID of each individual mouse to&#160;software according to the location of the HRA, either&#160;left side or&#160;right side. (Figure 4). 
		Note: The location should be counterbalanced with respect to genotype groups. For 50% of each genotype group, the HRA is always on the left and the LRA is always on the right. For the other 50%, the HRA is always on the right and the LRA is always on the left.</li>
		<li>Open the application window of the software, select &#34;Decision Making&#34; from the dropdown &#34;Task&#34; list. Input subject ID and select &#34;Phase 2&#34; from the &#34;Phase&#34; dropdown list. Select day number from the &#34;Day&#34; dropdown list. Press &#34;OK&#34; button to enter the experiment interface window.&#160;</li>
		<li>In the experiment interface window, press &#34;GetBG&#34; to register the background information of the maze so that the animal will be accurately tracked regardless of the background of the environment. Press the &#34;SESSION START&#34; button (Figure 5).&#160;</li>
		<li>Place the mouse in the start box and initiate the training by pressing the &#34;start&#34; button of the remote control.
		<ol>
			<li>Note that the start door, one&#160;junction door (either left or right side)&#160;will automatically open after 3 s; once the mouse enters the junction area, the start door will automatically close.</li>
			<li>Observe that once the mouse enters the delay area (either left or right side), the junction door will automatically close and the goal door will automatically open.</li>
			<li>Observe that once the mouse takes the pellet, the back door and pre-start door will automatically open. Once the mouse enters the back area, the back door will automatically close.</li>
			<li>Observe that once the mouse enters the start box, the pre-start door will automatically close, and a new trial will start. 
			Note: Within 10 trials of each day during this training phase, the software will automatically ensure that each mouse visits the HRA for 5 trials and the LRA for 5 trials.</li>
		</ol>
		</li>
		<li>Clean the maze thoroughly every day.</li>
	</ol>
	</li>
	<li>Free arm entry phase
	<ol>
		<li>Register parameters and Subject ID in the same way as done in the forced entry phase (step 3.1.1 and 3.1.2). Choose the &#34;phase option&#34;. Set the &#34;trial number&#34; to 20, so that each animal will go through 20 trials, per day for 7 continuous days.</li>
		<li>In the application window, select &#34;Phase 3&#34; from the &#34;Phase&#34; dropdown list. Set other parameters as per step 3.1.3.</li>
		<li>In the experiment interface window, set the value of &#34;Success Rate&#34; as 80% so that the training will automatically continue until the mouse selects the HRA in 80% of trials, or when the mouse finishes 20 trials per day (as is registered in parameters setup). Apply other operations as per step 3.1.4.</li>
		<li>Allow the mouse to freely choose one arm, either HRA or LRA.&#160;
		<ol>
			<li>Note that the start door, two junction doors will automatically open after 3 s; once the mouse enters the junction area, the start door will automatically close.</li>
			<li>Observe that once the mouse chooses one arm and enters the delay area (either left or right side), the junction door will automatically close and the goal door will automatically open.</li>
			<li>Observe that once the mouse takes the pellet, the back door and pre-start door will automatically open. Once the mouse enters the back area, the back door will automatically close.</li>
			<li>Observe that once the mouse enters the start box, the pre-start door will automatically close, and a new trial will start.&#160;</li>
		</ol>
		</li>
	</ol>
	</li>
</ol>
4. Delay-based Decision-making Test
<ol>
	<li>Register parameters and Subject ID in the same way as done in the free arm entry phase (step 3.2.1). Set the &#34;Delay time&#34; to 5, 10,15 s on day 1, day 2 and day 3 respectively, so that there will 5 s delay for HRA on day 1, 10 s delay for HRA on day 2, and 15 s delay for HRA on day 3.&#160;</li>
	<li>In the application window, select &#34;Phase 4&#34; from the &#34;Phase&#34; dropdown list. Set other parameters in the same way as in 3.2.2.</li>
	<li>In the experiment interface window, apply all the operations as per step 3.2.3.</li>
	<li>Allow the mouse to freely choose one arm, either HRA or LRA.&#160;
	<ol>
		<li>Note that the start door, two junction doors will automatically open after 3 s; once the mouse enters the junction area, the start door will automatically close.</li>
		<li>Observe that once the mouse chooses one arm and enters the delay area (either left or right side), the junction door will automatically close. 
		Note: If the mouse chooses LRA, the goal door will automatically open immediately. However, if the mouse chooses HRA, the goal door will automatically open after 5 s, 10 s, and 15 s on days 1, 2, 3 respectively.&#160;</li>
		<li>Observe that once the mouse takes the pellet, the back door and pre-start door will automatically open. Once the mouse enters the back area, the back door will automatically close.</li>
		<li>Observe that once the mouse enters the start box, the pre-start door will automatically close, and a new trial will start.&#160; 
		Note: Here, we trained the mice for 5&#8211;7 days with each delay condition. However, based on our experience on testing multiple lines of transgenic or mutated mice, 1 day (20 trials) is absolutely enough to see the difference between the mice of different genotypes and there is no meaning to extend the training time (See Figure 6 as an example). Therefore, currently we only apply 1 day for each delay time and it works well. There will be no problem if researchers want to elongate the training days depending on their own purpose.</li>
	</ol>
	</li>
	<li>Optional: Perform the test with the HRA reversed. To test if the mouse&#8217;s choice is the result of an orientation preference, switch the left/ right position of the HRA and the LRA (which can be accomplished automatically by the software) and allow the mice to freely choose one arm as in 4.4.&#160;</li>
	<li>Optional: Perform a delay control test. To test whether any deficit observed is the result of altered spatial memory or reward sensitivity rather than the result of changes in decision making, introduce a 15 s delay to the LRA as well as the HRA, and allow the mice to freely choose one arm as in 4.4.&#160;</li>
</ol>
5. Effort-based Decision-making Test
<ol>
	<li>Introduce the barrier to the HRA as shown in the diagram (Figure 1).</li>
	<li>Set up all the parameters and apply all the operations as per step 3.2 &#8212; free arm entry phase and test the animals for 3 continuous days.</li>
	<li>Allow the mice to freely choose one arm, either HRA or LRA. 
	NOTE: Here, we trained the mice for 14 days. However, based on our experience on testing multiple lines of transgenic or mutated mice, 3 days are absolutely enough to see the difference between the mice of different genotypes and there is no meaning to extend the training time (See Figure 6 as an example). Therefore currently we only apply 3 days for effort-based test and it works well. There will be no problem if researchers want to elongate the training days depending on their own purpose.</li>
	<li>Optional: Perform the test with the HRA reversed. To test if the mouse&#8217;s choice is the result of an orientation preference, switch the left/ right position of the HRA and the LRA (which can be accomplished automatically by the software) and allow the mice to freely choose one arm as in step 5.3.</li>
	<li>Optional: Perform effort control test. To test whether any deficit observed is the result of altered spatial memory or reward sensitivity rather than the result of changes in decision making, introduce a barrier to the LRA as well as the HRA, and allow the mice to freely choose one arm as in step 5.3.&#160;</li>
</ol>
6. Data Analysis
<ol>
	<li>Obtain data and results directly from the control software.
	<ol>
		<li>Note that the software will automatically record experimental date, start and finish time, duration, trial number, the location of the HRA, pellet number in the HRA and the LRA, the position (X, Y), and the moving trace etc., of each mouse in the &#34;Data&#34; folder.</li>
		<li>Check that the software has automatically analyze&#160;the following items and record&#160;them in the &#34;Result&#34; folder under each animal ID: Duration, trial number, HRA choice number, LRA choice number, HRA choice percentage, LRA choice percentage, total moving distance, and total junction time.</li>
	</ol>
	</li>
	<li>Perform statistical analysis on the data from all experiments by a mixed ANOVA (split-plot ANOVA), with day/session as within-subject factor and group factor (genotype group or groups with different experimental conditions) as between-subject factor.</li>
	<li>Analyze the main effect of group factor if there is no interaction between day/session with group factor. Apply post hoc pairwise comparisons if there is a significant interaction between day/session with group factor.</li>
</ol>

     

<ol>
	<li>Frank, M. J., Scheres, A., Sherman, S. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Understanding+decision-making+deficits+in+neurological+conditions:+insights+from+models+of+natural+action+selection.">Understanding decision-making deficits in neurological conditions: insights from models of natural action selection.</a> Philosophical Transactions of the Royal Society B: Biological Sciences. 362 (1485), 1641-1654 (2007).</li><li>Prevost, C., Pessiglione, M., Metereau, E., Clery-Melin, M. L., Dreher, J. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Separate+valuation+subsystems+for+delay+and+effort+decision+costs.">Separate valuation subsystems for delay and effort decision costs.</a> J Neurosci. 30 (42), 14080-14090 (2010).</li><li>Kennerley, S. W., Walton, M. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Decision+Making+and+Reward+in+Frontal+Cortex:+Complementary+Evidence+From+Neurophysiological+and+Neuropsychological+Studies.">Decision Making and Reward in Frontal Cortex: Complementary Evidence From Neurophysiological and Neuropsychological Studies.</a> Behavioral Neuroscience. 125 (3), 297-317 (2011).</li><li>Kurniawan, I. T., Guitart-Masip, M., Dolan, R. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dopamine+and+Effort-Based+Decision+Making.">Dopamine and Effort-Based Decision Making.</a> Frontiers in Neuroscience. 5, 81 (2011).</li><li>Izquierdo, A., Belcher, A. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Rodent+models+of+adaptive+decision+making.">Rodent models of adaptive decision making.</a> Methods Mol Biol. 829, 85-101 (2012).</li><li>Thiebot, M. H., Le Bihan, C., Soubrie, P., Simon, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Benzodiazepines+reduce+the+tolerance+to+reward+delay+in+rats.">Benzodiazepines reduce the tolerance to reward delay in rats.</a> Psychopharmacology. 86 (1-2), 147-152 (1985).</li><li>Green, M. F., Horan, W. P., Barch, D. M., Gold, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effort-Based+Decision+Making:+A+Novel+Approach+for+Assessing+Motivation+in+Schizophrenia.">Effort-Based Decision Making: A Novel Approach for Assessing Motivation in Schizophrenia.</a> Schizophr Bull. 41 (5), 1035-1044 (2015).</li><li>Fatahi, Z., Sadeghi, B., Haghparast, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Involvement+of+cannabinoid+system+in+the+nucleus+accumbens+on+delay-based+decision+making+in+the+rat.">Involvement of cannabinoid system in the nucleus accumbens on delay-based decision making in the rat.</a> Behav Brain Res. 337, 107-113 (2018).</li><li>Iodice, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Fatigue+modulates+dopamine+availability+and+promotes+flexible+choice+reversals+during+decision+making.">Fatigue modulates dopamine availability and promotes flexible choice reversals during decision making.</a> Sci Rep. 7 (1), (2017).</li><li>Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., Rushworth, M. F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Separate+neural+pathways+process+different+decision+costs.">Separate neural pathways process different decision costs.</a> Nat Neurosci. 9 (9), 1161-1168 (2006).</li><li>Bonnelle, V., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Characterization+of+reward+and+effort+mechanisms+in+apathy.">Characterization of reward and effort mechanisms in apathy.</a> J Physiol Paris. 109 (1-3), 16-26 (2015).</li><li>Hartmann, M. N., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Apathy+but+not+diminished+expression+in+schizophrenia+is+associated+with+discounting+of+monetary+rewards+by+physical+effort.">Apathy but not diminished expression in schizophrenia is associated with discounting of monetary rewards by physical effort.</a> Schizophr Bull. 41 (2), 503-512 (2015).</li><li>Lockwood, P. L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Prosocial+apathy+for+helping+others+when+effort+is+required.">Prosocial apathy for helping others when effort is required.</a> Nat Hum Behav. 1 (7), (2017).</li><li>Kobayashi, Y., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Genetic+dissection+of+medial+habenula-interpeduncular+nucleus+pathway+function+in+mice.">Genetic dissection of medial habenula-interpeduncular nucleus pathway function in mice.</a> Frontiers in behavioral neuroscience. 7 (17), (2013).</li><li>Hanks, T. D., Summerfield, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Perceptual+Decision+Making+in+Rodents,+Monkeys,+and+Humans.">Perceptual Decision Making in Rodents, Monkeys, and Humans.</a> Neuron. 93 (1), 15-31 (2017).</li><li>Lee, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Decision+Making:+from+Neuroscience+to+Psychiatry.">Decision Making: from Neuroscience to Psychiatry.</a> Neuron. 78 (2), 233-248 (2013).</li><li>Carandini, M., Churchland, A. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Probing+perceptual+decisions+in+rodents.">Probing perceptual decisions in rodents.</a> Nature Neuroscience. 16 (7), 824-831 (2013).</li><li>Denk, F., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Differential+involvement+of+serotonin+and+dopamine+systems+in+cost-benefit+decisions+about+delay+or+effort.">Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort.</a> Psychopharmacology. 179 (3), 587-596 (2005).</li><li>Walton, M. E., Bannerman, D. M., Rushworth, M. F. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Role+of+Rat+Medial+Frontal+Cortex+in+Effort-Based+Decision+Making.">The Role of Rat Medial Frontal Cortex in Effort-Based Decision Making.</a> The Journal of Neuroscience. 22 (24), 10996-11003 (2002).</li><li>Bardgett, M. E., Depenbrock, M., Downs, N., Points, M., Green, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dopamine+Modulates+Effort-Based+Decision-Making+in+Rats.">Dopamine Modulates Effort-Based Decision-Making in Rats.</a> Behavioral Neuroscience. 123 (2), 242-251 (2009).</li><li>Floresco, S. B., Tse, M. T., Ghods-Sharifi, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dopaminergic+and+glutamatergic+regulation+of+effort-+and+delay-based+decision+making.">Dopaminergic and glutamatergic regulation of effort- and delay-based decision making.</a> Neuropsychopharmacology. 33 (8), 1966-1979 (2008).</li><li>Assadi, S. M., Yucel, M., Pantelis, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dopamine+modulates+neural+networks+involved+in+effort-based+decision-making.">Dopamine modulates neural networks involved in effort-based decision-making.</a> Neuroscience &amp; Biobehavioral Reviews. 33 (3), 383-393 (2009).</li></ol>

The authors have nothing to disclose.

Decision making is a cognitive process highly conserved during evolution15. Humans and animals can evaluate the cost of competing action options relative to the potential reward and then make their choice. Patients suffering from a number of neurological diseases and psychological disorders demonstrate deficits in different forms of decision making16. It is therefore important to investigate the neurobiological and pathophysiological mechanisms underlying the decision-making process. In the past few years, delay- and effort-based decision making is attracting more and more research interest. Furthermore, rodents, especially rats have been extensively used to study these two forms of decision-making17.
Many studies led to interesting discoveries using a behavioral task involving a T-maze apparatus with a HRA and a LRA2,6,7,8,9,10,18,19,20,21,22. In the task, HRA associates large rewards with either a time delay or effort exertion. On the LRA, animals can acquire a small reward immediately without any time delay and physical effort. The traditional approach relies on human experimenter&#39;s manual intervention. In each trial, the experimenter needs to count the pellets and place them in the food trays of HRA and LRA, place the goal doors on both HRA and LRA, and then place the animal at the end of the start arm. When the animal enters either of the arms, a junction door needs to be placed to restrict the animal to the goal arm. Depending on the protocol, the experimenter needs to count the time and open the goal door after a set delay. After the animal enters the goal area and obtains the pellet(s), the experimenter needs to return it to the cage, and record the animal&#39;s arm choice and behavior. Then the experimenter needs to prepare the T-maze doors and pellet for the next trial. The whole training and testing processes are tremendously time and labor intensive. Furthermore, a lack of standardization across different labs is another concern.
In this paper, we presented&#160;a protocol&#160;based upon a modified&#160;automated T-maze apparatus with a video-tracking system (Figure 7) to solve the problems of traditional protocols. By introducing a &#34;back door&#34; and &#34;back corridor&#34; to the traditional T-maze, we obtained maze with a &#34;bisected isoceles triangle&#34; shape. The advantages of this&#160;setup are (1) full automation of the behavioral training and testing. This removes the impact of experimenter subjectivity&#160;and minimizes human time and labor commitments. We have four setups in the lab, so that four mice could be trained or tested simultaneously by one experimenter, which is impossible to be accomplished using traditional protocols. (2) There is software flexibility as the control software allows experimenters to freely set up multiple parameters, including pellet number, delay time, door opening and closing, trial numbers, duration, and trace mode. Therefore, this system can meet different kinds of experimental needs. (3) There is broad compatibility as all sliding doors on the T-maze are designed to be stored under the base of the maze when they are open. Therefore, the setup can be easily integrated with diverse physiological systems, including optogenetic/optical manipulation, in vivo electrophysiology recording, and microdialysis. In addition, for excluding the possibility that the mice chose the HRA due to a position preference, we recommend applying a control test for both the delay- and effort- based assay. By equalizing the costs in the two goal arms, animals have the opportunity to experience both reward outcomes at the same cost. The choice can be made simply on the basis of the reward differential, thus removing the need to integrate both costs and benefits before deciding. This also tests whether any change in the animals&#39; choices is the result of an inability to scale the cost or reward, or memory deficit rather than an alteration in the way in which they assessed their decisions.
In our lab, we have analyzed about 10 strains of mice with this setup. One example was shown in the representative data, mHb:DTA mice demonstrated a robust phenotype in both delay- and effort- based decision making. That is, reward value is strongly discounted by time and effort in mHb:DTA mice. The result revealed the important role of mHb on impulsivity control. In addition, we have applied silicon probe recordings on free moving mice during the decision-making process (unpublished data). All the experiments provided validation benchmarks for the capability of the automated setup. Thus, the standardized protocol for the T-maze based decision making with the automated apparatus is suitable for detecting genetic effects, pharmacological effects and neural circuit effects on delay and effort discounting of rodents. In summary, the setup has many advantages to serve as an ideal system for the delay- and effort-based decision-making assays.

Humans and other animals evaluate the cost (including delay, effort, and risk) to get a reward, and then make their decision to choose a certain course of action. Decision-making deficits appear in numerous neuropsychiatric diseases, including schizophrenia (SZ), attention deficit hyperactivity disorder (ADHD), obsessive-compulsive disorder (OCD), Parkinson&#39;s disease (PD) and addiction1. Studies on humans and monkeys revealed that several key brain regions are involved in decision making2,3,4. Although primates engage in more complicated decision makings, rodents have been reported to be able to make adaptive decisions to survive in an environment where reward contingencies change frequently. In addition, the neural circuit mechanisms and molecular mechanisms underlying decision making can be thoroughly investigated in mouse models due to the availability of chemogenetic tools, optogenetic tools and genetically engineered mice. There are multiple tasks used in evaluating rodents&#39; decision-making behaviors, including the attentional set-shift task, the effortful or delay-based T-maze task, the Iowa gambling task, the visual discrimination reversal learning task5, etc. Analogous T-maze cost-benefit protocols were originally developed by the Pierre group6 and have been used to examine the effects of two types of decision cost (delay and effort) on free moving rodents7,8,9,10. The special advantage of this task is that animals do not have to be trained to press levers or dig in a bowl. Instead, animals make a choice between a high reward high cost option in one arm (the HRA) or a low reward low cost option in the other arm (the LRA). Therefore, this task is much easier to perform.
In the delay-based paradigm, a junction door is introduced once the experimental animal enters one of the goal arms, so that the animal is kept in the goal arm. If the animal chooses the LRA, the goal door on the LRA is retracted immediately and a small quantity of food is delivered. If the animal chooses the HRA, the goal door on the HRA is retracted after the required delay and a large quantity of food pellets is delivered (Figure 1A). In the effort-based paradigm, the HRA is obstructed by a barrier and animals must climb over it to obtain a large quantity of pellets (Figure 1B). Generally speaking, the delay-based paradigm is very useful to test the impulsivity of animal models and the effort-based one can help to figure out apathetic animals2,4,11,12,13. Hitherto researchers have been performing this assay by manually counting the time delay, inserting and withdrawing doors, maneuvering the effort barrier, counting the pellet number, placing pellets into position, placing and returning animals, and recording animals&#39; choices for every trial. These labor and time costs pose a severe experimental bottleneck for researchers, hampering widespread use of this behavioral assay. In current work, we developed a T-maze based setup to assess delay- or effort-based decision making of rodents, with full automation, standardization, and high-throughput capacity.
Apparatus
In collaboration with a commercial manufacturer (see Table of Materials), we developed a modified&#160;automated T-maze apparatus which used&#160;software-based instrument control (Figure 2). In particular, we introduced a &#34;back door&#34; and &#34;back way&#34; as compared to the traditional T-maze (Figure 2), so that animals could go back to the start point themselves and start a new trial. The T-maze is matte grey colored, and when the experiment condition and software are set properly, both black and white mice can be detected. It is comprised of three arms: one start arm and two goal arms, each 410 mm in length with V-shaped walls of 155 mm in height, a base of 30 mm in width and an open top of 155 mm in width. The V-shaped corridor can effectively prevent mice from jumping. In addition, the V-shaped corridor makes it easier to apply in vivo recording with cables.A start box is attached to the end of the start arm. A goal box is attached to the end of each goal arm. An automatic food dispenser is installed in each goal box to deliver a predefined number of sweet food pellets. The pellet intake is detected by an infrared sensor and is automatically recorded by a computer. Each goal box is connected to the start box by a straight corridor. Animals can autonomously return to the start box via the corridor once they finish a trial. There are sliding doors of 155 mm in height at the entrance and exit of start and goal boxes. Additionally, a sliding door is located at the entrance of each goal arm to prevent animals from moving backwards after making a choice (Figure 2A). All sliding doors are controlled by a computer and can be automatically opened and closed. A high sensitivity 1/2&#34; charge coupled device (CCD) monocle camera is set above the apparatus to track the animals&#39; behavior. The focal length of the lens is 2.8&#8211;12 mm. The position of camera is around 1.9 m high. Since the height of maze is 0.5 m from floor, the distance between camera and the maze is around 1.4 m (Figure 2B). The tracking data obtained from the CCD camera is used to live-control the T-maze, opening and closing the specific doors when animals enter certain regions of interest (ROIs). The barriers used for the effort-based paradigm are in the shape of a three-dimensional right-angled triangle (Figure 2C), which perfectly fits in the V-shaped walls, and are about 155 mm in height. Animals must scale the vertical side but are able to descend a 45&#176; slope. The apparatus is illuminated at 100 lux during the experiment. Sugar pellets used in the experiment (see Table of Materials),&#160;and silica-gel (see Table of Materials) is used to keep the pellets dry.

<table border="0" cellpadding="0" cellspacing="0" width="1063">
	<tbody>
		<tr height="93">
			<td height="93" style="height:93px;width:328px;">automated t-maze for decion making testing</td>
			<td style="width:123px;">O&#8217;HARA &#38; Co.,ltd</td>
			<td style="width:243px;">no catalog number, customorized</td>
			<td style="width:371px;">Address requested by the reviewer: 4-28-16 Ekoda, Nakano-ku, Tokyo 165-0022 
			TEL: 81-3-3389-2451 FAX:81-3-3389-2453</td>
		</tr>
		<tr height="40">
			<td height="40" style="height:40px;">slica gel&#160;</td>
			<td>Nacalai Tesque</td>
			<td>1709155</td>
			<td></td>
		</tr>
		<tr height="40">
			<td height="40" style="height:40px;">AIN-76A Rodent Tablet 10mg</td>
			<td>Test Diet</td>
			<td>1811213(5TUL)</td>
			<td>Manufactured for Japan,SLC</td>
		</tr>
		<tr height="40">
			<td height="40" style="height:40px;">Time TM1 software&#160;</td>
			<td>O&#8217;HARA &#38; Co.,ltd</td>
			<td>no catalog number</td>
			<td></td>
		</tr>
		<tr height="40">
			<td height="40" style="height:40px;">SPSS statistics V21.0</td>
			<td>IBM</td>
			<td></td>
			<td></td>
		</tr>
	</tbody>
</table>

an automated t-maze based apparatus and protocol for analyzing delay- and effort-based decision making in  free moving rodents

Many neurological and psychiatric patients demonstrate difficulties and/or deficits in decision making. Rodent models are helpful to produce a deeper understanding of the neurobiological causes underlying the decision-making problems. A cost-benefit based T-maze task is used for measuring decision making in which rodents choose between a high reward arm (HRA) and a low reward arm (LRA). There are two paradigms of the T-maze decision-making task, one in which the cost is a time delay and the other in which it is physical effort. Both paradigms require a tedious and labor-intensive management of experimental animals, multiple doors, pellet reward, and arm choice recordings. In the current work, we invented an apparatus based on traditional T-maze with full automation for pellet delivery, door management and choice recordings. This automated setup can be used for the evaluation of both delay- and effort-based decision making in rodents. With the protocol described here, our lab investigated the decision-making phenotypes of multiple genetically modified mice. In the representative data, we showed that the mice with ablated medial habenular showed aversions of both delay and effort and tended to choose the immediate and effortless reward. This protocol helps to decrease the variability caused by experimenter intervention and to enhance experiment efficiency. In addition, chronic silicon probe or microelectrode recording, fiber-optic imaging and/or manipulation of neural activity can be easily applied during the decision-making task using the setup described here.

An example of the delay- and effort- based decision-making task performed by medial habenular ablated mice (mHb:DTA mice)14&#160;with their wild-type littermate control mice (CT mice) is shown in Figure 6. Two mHb:DTA mice and two CT mice were co-housed in one cage after weaning.
In the delay-based decision-making test (Figure 6A), there was no significant interaction between&#160;genotype and&#160;session in any phase, including the discrimination training phase (when the delay time of HRA was 0) and delay-based decision-making test phase (when the delay time of HRA was 5 s, 10 s, and 15 s, respectively). The main effect of genotype was not significant when the delay time was 5 s. However, when the delay time was elongated to 10 s and 15 s, mHb:DTA mice demonstrated a significant reduction in the percentage of HRA visits compared to CT mice. These results revealed that the ablation of mHb decreased the preference of mice to wait for a bigger reward, and instead displayed a tendency to select a small reward immediately, when the waiting times were 10 seconds or even longer. The data suggested that mHb might be an important brain structure in the control of impulsivity and/or time cost/benefit evaluation, rendering animals more prone to tolerate delayed access to get a large reward.
In the effort-based decision-making test (Figure 6B), the percentage of HRA visits were significantly decreased in mHb:DTA mice when a barrier was placed in the HRA, regardless of the left/right localization of the HRA (1x barrier phase and reversal phase). This means that the phenotype of mHb:DTA mice was not due to a deficit in spatial preference and memory. In the effort control test, barriers were placed in both goal arms (2&#215; barriers phase) and both LRA and HRA were associated with high effort. Therefore, the effort cost was the same for animals selecting either the low reward or the high reward. The mHb:DTA mice visited the HRA more frequently than the LRA, and reached a comparable HRA visit number on the final session (session 5). This result suggests that reward sensitivity and spatial memory in mHb:DTA mice was intact. The data elucidated that mHb may play an important role in effort cost/benefit evaluation, allowing animals to put in more work to acquire greater rewards.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/57895/57895fig1.jpg" /> 
Figure 1: Schematic diagram of traditional T-maze apparatus for decision-making test. (A) Delay-based decision-making test apparatus. Animals were placed in the start arm and chose between two goal arms, HRA and LRA. When animals chose the HRA, they had to wait (depending on the delay time in seconds) to get a larger reward. Researchers need to manually handle animals, pellets, and doors for each trial. (B) Effort-based decision-making test apparatus. Animals were placed in the start arm and chose between two goal arms, HRA and LRA. When animals chose the HRA, they had to climb over a triangular barrier to get a larger reward. Researchers need to manually handle animals, pellets, doors and barriers for each trial. <a href="https://www.jove.com/files/ftp_upload/57895/57895fig1large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/57895/57895fig2.jpg" /> 
Figure 2: Automated T-maze setup for decision-making test. (A) Top view of the automated setup. (B) Side View of the automated setup. (C) The 3D right-angle triangle barrier used for effort-based decision-making test, from left to right, are the side view, the opposite side view and the hypotenuse side view, respectively. Original technical photos edited with permission from the commercial manufacturer. GBL: goal box (left), GBR: goal box (right), GDL: goal door (left), GDR: goal door (right), DAL: delay area (left), DAR: delay area (right), JDL: junction door (left), JDR: junction door (right), BDL: back door (left), BDR: back door (right), CCD: charge coupled device camera). <a href="https://www.jove.com/files/ftp_upload/57895/57895fig2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 3" class="xfigimg" src="/files/ftp_upload/57895/57895fig3v2.jpg" /> 
Figure 3: The Parameter registration window. <a href="https://www.jove.com/files/ftp_upload/57895/57895fig3v2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 4" class="xfigimg" src="/files/ftp_upload/57895/57895fig4v2.jpg" /> 
Figure 4: The Subject ID registration window.&#160;<a href="https://www.jove.com/files/ftp_upload/57895/57895fig4v2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 5" class="xfigimg" src="/files/ftp_upload/57895/57895fig5v2.jpg" /> 
Figure 5: The experiment interface window.&#160;<a href="https://www.jove.com/files/ftp_upload/57895/57895fig5v2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 6" class="xfigimg" src="/files/ftp_upload/57895/57895fig6v2.jpg" /> 
Figure 6: Delay-based and effort-based decision making in mHb:DTA mice. (A) Delay-based decision-making test in mHb:DTA mice (mice were 12&#8211;14 months-old, n = 8/genotype). The percentage of HRA choice was comparable between genotypes when the delay time was 0 and 5 s, but significantly decreased in mHb:DTA mice when the delay time was 10 s and 15 s. When the delay time was 5 s, genotype&#215;day interaction: F(1,14) = 0.594, p = 0.236; the effect of genotype: F(1,14) = 0.61, p = 0.45; when the delay time was 10 s: genotype&#215;day interaction: F(1,14) = 37.5, p = 0.346; the effect of genotype: F(1,14) = 32.4, p &#60;0.0001; when the delay time was 15 s: F(1,14) = 38.7, p = 0.243; the effect of genotype: F(1,14) = 31.6, and p &#8804;0.0001. (B) Effort-based decision-making test in mHb:DTA mice (mice were 12-14 months-old, n = 9/genotype). During 1x barrier phase, there was a significant interaction between genotype and session (genotype&#215;day interaction: F(1,16) = 2.11, p = 0.015), and the post hoc pairwise comparison revealed that HRA% of mHb:DTA mice significantly dropped in all sessions. During the reversal phase, there was no significant interaction between genotype and session (genotype&#215;day interaction: F(1,16) = 1.61, p = 0.08). mHb:DTA mice visited HRA significantly less than CT mice (main genotype effect: F(1,16) = 8.18, p = 0.01). During 2&#215;barriers phase, there was a significant interaction between genotypes and sessions, and a significant difference in session 3 and session 4 (2x barriers phase: genotype&#215;day interaction: F(1,16) = 3.9, p = 0.0067). The mHb:DTA mice reached a HRA visit number comparable to that of CT mice on the final session, session 5. Data represent mean &#177; SEM. ** p &#60;0.01; *** p &#60;0.001. <a href="https://www.jove.com/files/ftp_upload/57895/57895fig6v2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 7" class="xfigimg" src="/files/ftp_upload/57895/57895fig7v2.jpg" /> 
Figure 7: The flowchart of decision making test (delay- or effort-based).

Watch this Scientific Journal Video about An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in  Free Moving Rodents at JoVE.com

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in  Free Moving Rodents

This article introduces an automated T-maze apparatus that we invented, and a protocol based on this apparatus for analyzing delay-based decision making and effort-based decision making in free moving rodents.

Many neurological and psychiatric patients demonstrate difficulties and/or deficits in decision making. Rodent models are helpful to produce a deeper ...

The traditional T-maze can be used to test both delay-and effort-based decision-making. In the current work, we invented a T-maze apparatus with automated food delivery, door management, and arm choice recordings. Our protocol here can dramatically save researchers time and labor while analyzing the decision-making ability of rodents.This protocol can help to answer the key questions in decision-making fields, such as what are the key neural circuits and molecules underlying decision-making procedure, and what are the neuropathological causes underlying decision-making deficits in psychiatric diseases? The implication of this protocol extend toward therapy of neuropsychiatry disease because many patients demonstrate difficulties or deficit in decision-making. Habituate mice to the maze for 10 minutes per day and totally for five days.Keep all the maze doors open during habituation. On day one, scatter the food pellets throughout the maze. Then, place the mice in the start box of the T-maze in groups of four, and allow the mice to explore the maze for 10 minutes.On days two and three, scatter the pellets along the two goal arms. Allow the mice to explore the maze for 10 minutes. Finally, on days four and five of habituation, put the pellets only very close to and at the food dispensers at the two goal boxes.Allow the mice to explore the maze for 10 minutes. For the forced arm entry phase, begin by setting up the control software parameters. Set the duration to 900 seconds.Set the default start delay time to three seconds, the pellet number to one for LRA and four for HRA, and set the delay time to zero seconds. Register the ID of each individual mouse to the software and the location of the HRA for each individual mouse, either on the left side or the right side. Then, enter the experiment interface window, place the mouse in the start box, and initiate the training by pressing the start button on the remote control.Note during each trial, only the doors leading to one arm will be open, while the doors on the opposite arm will not be open, and the doors automatically open or close according to the position of the animal. Here, the mouse was forced to enter the left side HRA in the first trial and eat the four pellets and to enter the right side arm in the second trial to eat the one pellet. This phase allows the mouse to learn the position of HRA and LRA.For the free arm entry phase, set the parameters by using the same method as used in the forced entry phase. Place the mouse in the start box, press the start button, then allow the mouse to freely choose one arm, either HRA or LRA. Begin by setting the delay time of the HRA to five seconds, 10 seconds, and 15 seconds on day one, day two, and day three, respectively.Set the phase number. Set all other parameters in the same manner as the forced arm entry phase. Allow the mouse to freely choose one arm, either HRA or LRA.In the two trials shown here, the mouse chose the LRA in the first trial and chose the HRA in the second trial. Next, for the effort-based decision-making test, introduce the barrier to the HRA. Allow the mice to freely choose one arm, either HRA or LRA.Here, the mouse chose to climb the barrier to get a higher reward. After the experiment is complete, obtain data and results from the control software. Look for all experimental data in the data folder.Finally, check items in the result folder, duration, trial number, HRA choice number, LRA choice number, HRA choice percentage, LRA choice percentage, total moving distance, and total junction time under each animal ID.The results shown here display the differences between delay-and effort-based decision-making ability between medial habenular ablated mice with their littermates, wild-type control mice. For the delay-based decision-making test, the main effect of genotype was not significant when the delay time was five seconds. However, when the delay time was elongated to 10 seconds and 15 seconds, the medial habenular ablated mice demonstrated a significant reduction in the percentage of HRA visits compared to CT mice.Lastly, in the effort-based decision-making test, the percentage of HRA visits were significantly decreased in the medial habenular ablated mice when a barrier was placed in the HRA, regardless of the left/right localization of the HRA. While attempting this procedure, it's important to remember food restriction should be done throughout all the training procedures to ensure the motivation of the rodent to perform the task. In addition, remember to use the tiny size 10-milligram pellets and use silica gel in the food dispensers to keep the pellet dry.Following this procedure, other methods like in vivo electrode recording, fiber optic imaging, optogenetics manipulation, and microdialysis can be performed in order to answer additional questions, for example, the dynamic changes of excitability of specific cell populations during delay and effort discounting and dynamic changes of neuropeptides, neurotransmitters, and hormones during decision-making. In one word, the current setup and the protocol that we developed allow researchers to efficiently analyze decision-making of rodents, with full automation, standardization, and high-throughput capacity. We believe that our invention can help to elucidate the mechanism underlying decision-making for both physiological and pathological conditions.

Research

JoVE Journal

Behavior

A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

Rodents have been traditionally used as a standard animal model in laboratory experiments involving a myriad of sensory, cognitive, and motor tasks. ...

A Protocol for Housing Mice in an Enriched Environment

Environmental enrichment (EE) is a housing environment for mice that boosts mental and physical health compared to standard laboratory housing. Our recent ...

An Unpredictable Chronic Mild Stress Protocol for Instigating Depressive Symptoms, Behavioral Changes and Negative Health Outcomes in Rodents

Chronic, unresolved stress is a major risk factor for the development of clinical depression. While many preclinical models of stress-induced depression ...

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Delay discounting refers to a decline in the value of a reward when it is delayed relative to when it is immediately available. Delay discounting tasks ...

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

We demonstrate a method for capturing emotional response to beverages and liquefied foods in a sensory evaluation laboratory using automated facial ...

Feeding Experimentation Device (FED): Construction and Validation of an Open-source Device for Measuring Food Intake in Rodents

Feeding Experimentation Device FED: Construction and Validation of an Open-source Device for Measuring Food Intake in Rodents

Food intake measurements are essential for many research studies. Here, we provide a detailed description of a novel solution for measuring food intake in ...

An Automated Rapid Iterative Negative Geotaxis Assay for Analyzing Adult Climbing Behavior in a Drosophila Model of Neurodegeneration

An Automated Rapid Iterative Negative Geotaxis Assay for Analyzing Adult Climbing Behavior in a Drosophila Model of Neurodegeneration

Neurodegenerative diseases are frequently associated with a progressive loss of movement ability, reduced life span, and age-dependent neurodegeneration. ...

Utilizing the Modified T-Maze to Assess Functional Memory Outcomes After Cardiac Arrest

Background: Evaluating mild to moderate cognitive impairment in a global cerebral ischemia (i.e. cardiac arrest) model can be difficult due to poor ...

Classical Short-Delay Eyeblink Conditioning in One-Year-Old Children

Classical eyeblink conditioning (EBC) refers to the learned association between a conditioned stimulus (an auditory tone) and an unconditioned stimulus (a ...

An Automated Method to Determine the Performance of Drosophila in Response to Temperature Changes in Space and Time

An Automated Method to Determine the Performance of Drosophila in Response to Temperature Changes in Space and Time

Temperature is a ubiquitous environmental factor that affects how species distribute and behave. Different species of Drosophila fruit flies have specific ...