Sign In

A subscription to JoVE is required to view this content. Sign in or start your free trial.

In This Article

  • Summary
  • Abstract
  • Introduction
  • Protocol
  • Results
  • Discussion
  • Disclosures
  • Acknowledgements
  • Materials
  • References
  • Reprints and Permissions

Summary

The study aims to develop technology for anesthesia-free heartbeat measurements in moving zebrafish. Our approach combines shortwave-infrared imaging and machine-learning-based tracking of the heart. It is a non-invasive, label-free, and user-friendly technique that suits a wide range of studies on the zebrafish model.

Abstract

Zebrafish (Danio rerio) is a widely used model organism in physiological, pharmacological, and toxicological research due to its genetic similarity to humans and transparent embryonic stage, which facilitates non-invasive cardiovascular studies. However, current methods for heart rate assessment in zebrafish often rely on anesthesia to immobilize the subject, introducing physiological alterations that compromise data accuracy and reproducibility. This study presents a novel, anesthesia-free technique for measuring heartbeat in freely moving zebrafish larvae, addressing a critical limitation in cardiovascular research. The proposed approach integrates shortwave-infrared imaging with machine-learning-based heart tracking, allowing for precise and continuous cardiac activity monitoring in non-immobilized specimens. A convolutional neural network was trained to detect the heart region, and a photoplethysmographic signal was extracted from image sequences to determine heart rate. Experimental validation demonstrated the method's reliability and consistency across multiple test conditions. A key benefit of the methodology is its ability to preserve the natural physiological state of zebrafish, minimizing stress-induced artifacts. This non-invasive, label-free technique offers significant advantages for studying cardiovascular physiology, drug cardiotoxicity, and environmental toxicology, expanding the potential applications of zebrafish as a model for biomedical research.

Introduction

Zebrafish (Danio rerio), a small cyprinid fish, has become an essential model organism due to its small size, high reproductive rate, and ease of genetic manipulation1,2,3. The assessment of heart rate in transparent zebrafish embryos is increasingly utilized in physiology, embryology, toxicology, and other fields4,5,6,7,8. On the one hand, this utility is due to the fact that the zebrafish genome includes genes associated with human cardiovascular diseases9, and the Danio rerio heart shares similar structures and signaling pathways with humans10,11. It makes zebrafish an invaluable model for studying heart development and diseases11,12,13. On the other hand, the zebrafish heart rate is sensitive to external influences, making it an excellent model for physiological and toxicological studies by comparing cardiac function in treated and untreated fish7,8,14.

Significant progress has been made in developing non-invasive optical methods for assessing heart rate in transparent fish embryos15,16. These techniques offer the advantage of rapid data collection from large sample sizes. Consequently, fully automated approaches for heart rate assessment in fish embryos have been developed4,5,6,17.

However, certain limitations currently restrict the use of these techniques to the 3-4 dpf period. The first limitation is a loss of transparency due to the pigmentation of the fish body. The second is the increasing movability of the embryos over time. Extending the period of zebrafish's early development during which the optical approaches can be used would enhance their utility, allowing long-term experimental designs to study cardiomyopathy, congenital heart defects, and various impacts on the cardiovascular system, including tracking the dynamics of effects over time. Our group recently addressed the issue of transparency loss by employing imaging in the shortwave infrared range of 900-1700 nm18. This paper focuses on addressing the issue of embryo mobility.

Typically, anesthetics like tricaine methanesulfonate (MS-222) are used to immobilize free-swimming fish embryos and larvae before imaging14,19,20. However, MS-222 significantly reduces heart rate21,22, as do other anesthetics23. It becomes challenging to discern whether observed changes in heart function are due to experimental treatment, the anesthetic, or an interaction between the two. Another way to extend the embryo's low mobility period is by reducing the temperature during early development8. However, this approach is not always compatible with the research goals and only minimally extends the registration period.

In this study, we introduce a novel method to address embryo mobility during heart rate registration. We trained a convolutional neural network to identify the region of interest of the heart in recordings of free-swimming zebrafish embryos. The periodic variation in pixel intensity within this area is utilized to derive the photoplethysmogram (PPG), which is subsequently used to calculate the heart rate. The developed desktop application, AutoHR, utilized both neural network training and image stack processing, ensuring ease of use and protocol reproducibility.

Protocol

Zebrafish were bred and raised according to established ZFIN protocols24. All procedures were approved by the Bioethics Committee of the Scientific and Technological Centre of Unique Instrumentation of the Russian Academy of Sciences (STC UI RAS), protocol #3/24, dated 08/21/2024, and follow the zebrafish care guidelines of STC UI RAS. Manuals for individual versions are available on request.

1. Preparation of equipment for measurement

  1. Selection of equipment
    1. Choose a light source: Choose an LED light source that emits in the near-infrared range, specifically from 800 nm, with a minimum power output of 3 W. This study used LED with a central wavelength of 940 nm and a bandwidth of 40 nm.
    2. Choose a video camera: Choose a camera equipped with a sensor sensitive to the wavelength range emitted by the light source and has a frame rate of at least 60 fps. Refer to the camera's datasheet to determine the pixel pitch p, the sensor size along its shorter side h, and the frame rate. In this study, the camera has a pixel pitch of p = 5 µm and a sensor width h = 5.12 mm.
    3. Choose an agarose mold size that is at least 1.5 times greater than the length of the larva B. Compute the minimum and maximum permissible magnifications of the optical system using the provided expressions. Ensure that Mmax Mmin. If this condition is not met, select a camera with a larger h and/or a smaller and/or smaller S.
      figure-protocol-1681
      figure-protocol-1780
      where Smax is the length of the largest agarose mold of the mold set. A set of molds in various sizes can be prepared. This study used S = 10 mm.
      NOTE: The equations are derived based on the optical scheme geometry and the body proportions of zebrafish. Detailed explanations are provided in the Discussion section.
    4. Choose a lens: This study used an optical system with variable magnifications ranging from MOSmin = 0.4x to MOSmax = 1.5x, a maximum focal length of fmax = 150 mm, and a working distance of mm.
      NOTE: The symbol x denotes the magnification factor of the optical system.
      1. Choose a variable magnification microscope-type system with a magnification range (MOSmin - MOSmax) that remains within the allowable range (Mmin - Mmax). Refer to the lens datasheet to determine the maximum focal length fmax and the corresponding working distance L for MOSmax.
      2. Ensure that the condition fmax ≤ Mmax L is satisfied. If this condition is not met, select a lens with a different fmax and/or L. Ensure that the mount type of the camera and lens are compatible.
    5. Choose a test object (a ruler or a grid) with a known pitch and a total length of at least . Choose a test object in the form of a ruler or grid with a known pitch and a total size of at least Smax.
  2. Assembly of a stand for image acquisition (Figure 1).
    1. Mount the round rod on a stable base. Assemble the imaging system by attaching the lens to the camera. Mount the imaging channel on the rod with the input window facing upward.
    2. Mount the focusing mechanism onto the rod. Attach a stage with a glass working surface with a minimum diameter of 30 mm to the focusing mechanism.
    3. Assemble the illuminator: Place LED on a metal substrate to ensure efficient heat dissipation. Place a convex flat collimator lens with a diameter of 23 mm and a focal length of 30 mm at a distance of 30 mm from LED.
    4. Mount the illuminator on the stage using a three-axis adjustable bracket, positioning it above the working surface with the lens facing downward.
    5. Adjust the illuminator and the imaging system. Position the illuminator coaxially with the imaging system. Turn on the illuminator and connect the camera to the computer.
    6. Launch the camera application and activate preview mode following the instructions in the camera manual. Place the test object on the stage. Adjust the working distance and magnification of the microscope to ensure that the size fits completely within the field of view.
      NOTE: The size should fit entirely along the short side of the frame to ensure complete visualization of the agarose mold.
    7. Adjust the position of the stage relative to the imaging system to ensure that the image is focused, and the illuminator's position is uniformly illuminated.
  3. Preparation of agarose mold
    1. Mix 20 mL of distilled water with 0.4 g of low-melt agarose and heat the mixture until the agarose completely dissolves. For example, in a microwave for 20 s at a power of 700 W.
    2. Shape the agarose mold (Method 1): Pour the heated solution into the Petri dish, ensuring a solution height of 1.5-2 mm. Cool the Petri dish until the agarose solution has solidified. At a temperature of 17 °C, this process takes about 5 min. Cut a square with a side length of using a stationery knife and carefully remove the agarose layer within the outlined area.
    3. Shape the agarose mold (Method 2): Create (S) × (S) × 10 mm, forms from plastic. Place the printed form with the square side in a Petri dish and fill it with the heated solution, ensuring a solution height of 1.5-2 mm. Cool the Petri dish until the agarose solution has solidified, and carefully remove the form from the solidified solution.
      NOTE: Forms can be easily printed using a 3D printer.

2. Image acquisition

  1. Adjust the image capture settings.
    1. Connect the camera to the computer. Launch the camera application and enable the preview mode. Turn on the illuminator.
      NOTE: If the size of the agarose mold to be used differs from that in step 1.3.3, repeat step 1.3.3 and remove the test object from the stage after that.
    2. Place the zebrafish larva in an agarose mold by a Pasteur pipette. Place an agarose mold on the stage. Ensure almost complete illumination of the larva head by adjusting a combination of exposure time and illuminator power (Figure 2A-C). The exposure time should not exceed 1.5 ms.
      NOTE: In this study, we present data for wild-type zebrafish larvae aged 12 to 21 days post-fertilization (dpf).
  2. Perform image acquisition
    1. Set the frame rate to at least 60 fps. Set the image bit depth to 12 bits. Acquire images for at least 10 s. Set the frame naming format to yyyy_mm_dd_hh_ss_mm_mss, and the file type must be either PNG or TIFF, not BMP.

3. Training the neural network for labeling

  1. Preparation of data for labeling
    NOTE: The process of labeling in the Image Labeler App, MATLAB, is described.
    1. Gather at least 256 acquired images in a separate directory. Run the App. Import the images by navigating to Import > From file and selecting all images from the specified directory.
    2. Create classes for network labeling. In the ROI Labels tab, click Label, enter body in the Label Name field, select Pixel Label from the drop-down menu for the label type, and click OK. In the ROI Labels tab, click Label, enter eye in the Label Name field, select Pixel Label from the drop-down menu for the label type, and click OK. In the ROI Labels tab, click Label, enter fish in the Label Name field, select Rectangle from the drop-down menu for the label type, and click OK.
  2. Labelling of the frames
    1. In the ROI Labels tab, select the previously created annotation class, eye. Outline one eye of the specimen by placing points along its perimeter using the left mouse button. To complete the annotation of the eye, click on the starting point of the outline (Figure 3B).
    2. Outline another eye of the specimen in the same manner as described in step 3.1.2.
    3. In the ROI Labels tab, select the created annotation class, body. Outline the body of the specimen, excluding the eyes, by placing points along its perimeter using the left mouse button. To complete the annotation of the eye, click on the Starting Point of the Outline.
    4. In the ROI Labels tab, select the previously created annotation class, fish. Outline the entire body of the specimen by drawing a rectangular bounding box (Figure 4). To do this, click on One Corner of the intended rectangle with the left mouse button, then drag the cursor while holding the button down until the rectangle fully encloses the fish.
    5. Save the outlines to a new directory named images by clicking Export > To File in the LABEL tab.
  3. Preparing Datasets for Neural Network Training
    1. Launch MATLAB. Open the script file DatasetsPreparation.m (Supplementary File 1) by selecting Open > Open.
    2. Run the script by clicking Run. In the pop-up window, select the directory containing the outlined images, the folder PixelLabelData, and the file gTruth.mat, which was exported in step 3.2.5.
      NOTE: Upon completion of the script execution, two folders - RPN Training and CNN Training - will be automatically generated. They are required for subsequent neural network training. Do not modify the contents of these folders.

4. Training the neural networks for heart detection

NOTE: This step is performed once for a specific age and imaging condition. NVIDIA GPU is strongly recommended for training as it significantly accelerates the processing.

  1. Launch the AutoHR application. Navigate to the Region Proposal Network Training tab. Click Choose Directory and select the RPN Training folder created in step 3.3.2. Click Start Training.
    NOTE: Upon completion of the training, a model file named rpn_model.pt will be generated in the same directory as the AutoHR.exe file. This file is required for further image stack processing.
  2. To train the Convolutional Neural Network, navigate to the Convolutional Neural Network Training tab. Click Choose Directory and select the CNN Training folder created in step 3.3.2. Click Start Training.
    NOTE: Upon completion of the training, a model file named model.pt will be generated in the same directory as the AutoHR.exe file. This file is required for further image stack processing.

5. Heart rate quantification

  1. Record a sequence of images as described in step 2. Ensure that the imaging conditions, such as magnification, exposure time, and illumination, are identical to those used for training the neural network.
  2. Launch the AutoHR application. Navigate to the Processing tab. Select the directory containing trained neural network models by clicking Choose Models. Click Choose Folder to import acquired images for analysis. The export path will be specified automatically, but you can change it by clicking Choose Export Path. Click Process to begin the analysis.
    NOTE: Upon completion, the heart rate value will appear in the Heart Rate field within the AutoHR interface. The exported folder will include the heart rate values (.xlsx), PPG (.xlsx), the first frame of the sequence, and the body and eye masks for the first frame (.png).

6. Verification of the algorithm outcomes

  1. Perform test with a motionless fish as described below.
    1. Anesthetize the larvae with 0.168 mg/L MS-222 solution for 1 min. Acquire an image stack of an anesthetized specimen as described in step 2. Perform a heart rate count through visual observation.
    2. Utilize the HR software as described in step 5. Repeat steps for several specimens. Verify whether the heart rate values obtained are consistent for all individuals within the desired accuracy.
  2. Perform the test with a mobile individual and provocation test as described below.
    1. Acquire an image stack of a non-anesthetized specimen as described in step 2. Conduct a provocation test with the individual for which the sequence was recorded, using a known stimulus that affects heart rate. The study presents results for water salinization to concentrations of 5 mg/L.
    2. Acquire an image stack of the same specimen as described in step 2 after the provocation test. Determine the heart rate in both experiments with the HR software as described in step 5. Verify whether the observed changes in heart rate align with the known effects of the provocation test.

Results

The heart rate of zebrafish at 12 dpf was determined using the protocol described above (Supplementary Video 1). The videos include a sequence of images of free-swimming zebrafish larvae, a photoplethysmogram derived from these sequences using the proposed protocol, and the corresponding heart rate calculated from the photoplethysmogram.

The labeled data were randomly split into training, testing, and validation sets in a 3:2:1 ratio during training. The loss function was then...

Discussion

In this study, we present an experimental protocol for measuring the heartbeat of free-swimming zebrafish larvae. We evaluated this approach through several experiments, demonstrating its effectiveness. The key components of the proposed method include both hardware and software solutions. Firstly, we used infrared illumination for imaging, which, as previously demonstrated, avoids issues related to pigmentation and enhances tissue transparency, facilitating accurate heartbeat determination18. Sec...

Disclosures

All authors have disclosed any conflicts of interest.

Acknowledgements

This study was supported by the Federal State Task Program of STC UI RAS (FFNS-2025-0008). This work was performed using the equipment of the Center for Collective Use of STC UI RAS [http:// https://ckp.ntcup.ru/en/].

Materials

NameCompanyCatalog NumberComments
Reagents
Low melting agaroseBiozym850111
Table saltPegasus N/A
Tricaine (Ethyl 3-aminobenzoate methanesulfonate) Sigma-AldrichE10505MS-222
Equipment
Base with rodAltamiSM-U1
Collimator lensJLLSCMGGXFocal length 30 mm
Focusing mechanismAltamiSM-12D=76 mm
LEDCreeTR-3535IR-3W
LensSFK SecurityC-Mount, F1.6, 1/3”,
Near infrared cameraToupTekSWIR1300KMA
Pasteur pipettePE-LD149293
Petri Dish 35 x 15 mm BD Falcon351008
Plastic formsN/AN/AMade by 3D printing
Power supplyUnit-TUTP3300TFL-II
StageN/AN/AMade by 3D printing
Stationery knifeErichKrause19145
Test objectWally SkyMS-1-EB
Software
EfficientDetN/AN/Ahttps://github.com/rwightman/efficientdet-pytorch
EfficientNet-b0 modelN/AN/Ahttps://arxiv.org/abs/1905.11946
Google API ClientGoogleN/AGoogle API Client is a Python client library for Google's discovery-based APIs. https://github.com/googleapis/google-api-python-client
Hardware
Multi-scale attention networkN/AN/Ahttps://arxiv.org/abs/2209.14145
NVIDIA DIGITSNVIDIAN/ANVIDIA DIGITS is a wrapper for Caffe that provides a graphical web interface. https://developer.nvidia.com/digits
NVIDIA GPUNVIDIAN/AAn NVIDIA GPU is needed as some of the software frameworks below will not work otherwise. https://www.nvidia.com
OpenCVIntelN/AOpenCV is a library for computer vision. https://opencv.org
PythonPython Software FoundationN/APython is a programming language. https://www.python.org

References

  1. Fontana, B. D., Mezzomo, N. J., Kalueff, A. V., Rosemberg, D. B. The developing utility of zebrafish models of neurological and neuropsychiatric disorders: A critical review. Exp Neurol. 299 (Pt A), 157-171 (2018).
  2. Chen, X., Li, Y., Yao, T., Jia, R. Benefits of zebrafish xenograft models in cancer research. Front Cell Dev Biol. 9, 616551 (2021).
  3. Lai, K. P., Gong, Z., Tse, W. K. F. Zebrafish as the toxicant screening model: Transgenic and omics approaches. Aquat Toxicol. 234, 105813 (2021).
  4. Pylatiuk, C., et al. Automatic zebrafish heartbeat detection and analysis for zebrafish embryos. Zebrafish. 11 (4), 379-383 (2014).
  5. Krishna, S., Chatti, K., Galigekere, R. R. Automatic and robust estimation of heart rate in zebrafish larvae. IEEE Trans Auto Sci Eng. 15 (3), 1041-1052 (2018).
  6. Gierten, J., et al. Automated high-throughput heartbeat quantification in medaka and zebrafish embryos under physiological conditions. Sci Rep. 10 (1), 2046 (2020).
  7. Meng, H., Liang, J., Zheng, X., Zhang, K., Zhao, Y. Using a high-throughput zebrafish embryo screening approach to support environmental hazard ranking for cardiovascular agents. Sci Total Environ. 702, 134703 (2020).
  8. Krylov, V., et al. Influence of hypomagnetic field on the heartbeat in zebrafish embryos. Front Physiol. 13, 1040083 (2022).
  9. Howe, K., et al. The zebrafish reference genome sequence and its relationship to the human genome. Nature. 496 (7446), 498-503 (2013).
  10. Staudt, D., Stainier, D. Uncovering the molecular and cellular mechanisms of heart development using the zebrafish. Ann Rev Gene. 46, 397-418 (2012).
  11. Bowley, G., et al. Zebrafish as a tractable model of human cardiovascular disease. Br J Pharmacol. 179 (5), 900-917 (2022).
  12. Brown, D. R., Samsa, L. A., Qian, L., Liu, J. Advances in the study of heart development and disease using zebrafish. J Cardiovas Dev Dis. 3 (2), 13 (2016).
  13. Dhillon, S. S., et al. Optimisation of embryonic and larval ECG measurement in Zebrafish for quantifying the effect of QT prolonging drugs. PLoS One. 8 (4), e60552 (2013).
  14. Bedrossiantz, J., et al. Heart rate and behavioral responses in three phylogenetically distant aquatic model organisms exposed to environmental concentrations of carbaryl and fenitrothion. Sci Total Environ. 865, 161268 (2023).
  15. Santoso, F., et al. An overview of methods for cardiac rhythm detection in zebrafish. Biomedicines. 8 (9), 329 (2020).
  16. Ling, D., Chen, H., Chan, G., Lee, S. M. Y. Quantitative measurements of zebrafish heartrate and heart rate variability: A survey between 1990-2020. Comp Biol Med. 142, 105045 (2022).
  17. Ferreira, M. S., et al. FEHAT: Efficient, large scale and automated heartbeat detection in medaka fish embryos. Bioinformatics. 40 (12), btae664 (2024).
  18. Volkov, M., et al. Optical transparency and label-free vessel imaging of zebrafish larvae in shortwave infrared range as a tool for prolonged studying of cardiovascular system development. Sci Rep. 12 (1), 20884 (2022).
  19. Machikhin, A., et al. Microscopic photoplethysmography-based evaluation of cardiotoxicity in whitefish larvae induced by acute exposure to cadmium and phenol. J Biophoton. 17 (9), e202400111 (2024).
  20. Machikhin, A. S., Burlakov, A. B., Volkov, M. V., Khokhlov, D. D. Imaging photoplethysmography and videocapillaroscopy enable noninvasive study of zebrafish cardiovascular system functioning. J Biophoton. 13 (7), e202000061 (2020).
  21. Denvir, M. A., Tucker, C. S., Mullins, J. J. Systolic and diastolic ventricular function in zebrafish embryos: Influence of norepenephrine, MS-222 and temperature. BMC Biotechnol. 8 (1), 1-8 (2008).
  22. Santoso, F., et al. Development of a simple ImageJ-based method for dynamic blood flow tracking in zebrafish embryos and its application in drug toxicity evaluation. Inventions. 4 (4), 65 (2019).
  23. Vieira, R. S. F., Sousa, D., Félix, L. M., Venâncio, C. A. S. Anaesthetic profile of thymol and menthol in zebrafish larvae model. Aquaculture and Fisheries. , (2024).
  24. Westerfield, M. . The zebrafish book. A guide for the laboratory use of zebrafish (Danio rerio). , (2000).
  25. Azad, R., et al. Loss functions in the era of semantic segmentation: A survey and outlook. ArXiv. , (2023).
  26. Machikhin, A. S., et al. Combined optical and acoustic microscopy for non-invasive cardiovascular studies using zebrafish model. IEEE Trans Instrument Measurement. 74, 1-13 (2025).
  27. Slavin, A. E., Guryleva, A. V., Bukova, V. I., Shuman, L. A., Burlakov, A. B. Wavelet analysis of Photoplethysmogram in zebrafish larvaе cardiovascular system Study. , 1-5 (2024).
  28. Kumari, S., Singh, D. Phenylthiourea-mediated experimental depigmentation reduces seizurogenic response of pentylenetetrazol in zebrafish larva. J Pharm Toxicol Methods. 128, 107532 (2024).
  29. Xu, Y., et al. Highly sensitive response to the toxicity of environmental chemicals in transparent casper zebrafish. Sci Total Environ. 948, 174865 (2024).
  30. Vedder, V. L., et al. pyHeart4Fish: Chamber-specific heart phenotype quantification of zebrafish in high-content screens. Front Cell Dev Biol. 11, 1143852 (2023).
  31. Lane, S., More, L. A., Asnani, A. Zebrafish models of cancer therapy-induced cardiovascular toxicity. J Cardiovas Dev Dis. (2), 8 (2021).
  32. Maciag, M., Wnorowski, A., Mierzejewska, M., Plazinska, A. Pharmacological assessment of zebrafish-based cardiotoxicity models. Biomed pharmacother. 148, 112695 (2022).
  33. Krylov, V. V., et al. Non-invasive recording of heartbeats in Danio rerio and Daphnia magna to assess the toxicity of imidacloprid and glyphosate. Comp Biochem Physiol C Toxicol Pharmacol. 288, 110075 (2025).
  34. Meng, H., Liang, J., Zheng, X., Zhang, K., Zhao, Y. Using a high-throughput zebrafish embryo screening approach to support environmental hazard ranking for cardiovascular agents. Sci Total Environ. 702, 134703 (2020).

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Explore More Articles

Anesthesia freeHeartbeat MeasurementsZebrafishDanio RerioCardiovascular ResearchNon invasiveMachine LearningPhotoplethysmographyHeart Rate AssessmentConvolutional Neural NetworkPhysiological StateDrug CardiotoxicityEnvironmental ToxicologyBiomedical Research

This article has been published

Video Coming Soon

JoVE Logo

Privacy

Terms of Use

Policies

Research

Education

ABOUT JoVE

Copyright © 2025 MyJoVE Corporation. All rights reserved