Name: Author Spotlight: Enhancing Rheumatoid Arthritis Research Through HR-pQCT Imaging Analysis
Uploaded: 2023-10-06T14:05:00
Duration: 1 min 29 s
Description: Watch this Scientific Journal Video about Enhancing Rheumatoid Arthritis Research Through HR-pQCT Imaging Analysis at JoVE.com

The authors would like to acknowledge the following funding agencies that supported this work. SLM is funded through The Arthritis Society (STAR-18-0189) and Canadian Institutes of Health Research Planning and Dissemination Grant. JJT holds a CIHR Fellowship award.

All methods in this protocol follow the guidelines set by the Conjoint Health Research Ethics Board at the University of Calgary (REB19-0387).
1. Install 3D Slicer&#160;15 and bone analysis modules
<ol>
	<li>Download the installation file for a stable release of 3D Slicer that is relevant to the operating system used from&#160;https://download.slicer.org/.</li>
	<li>Run the downloaded installation file and follow the instructions provided on the wizard.</li>
	<li>Once the installation is complete, proceed with installing the bone analysis modules.
	<ol>
		<li>Download the bone analysis modules from&#160;https://doi.org/10.5281/zenodo.7943007 as a compressed zip file and extract the compressed folder. Please note the directory where the extracted folder is located.</li>
		<li>Launch 3D Slicer. Load the modules onto 3D Slicer by clicking on Edit on the top left corner of the 3D Slicer window. Click on Edit &#62; Application Settings to open a new window.</li>
		<li>Click on Modules which is a tab located on the left on the recently opened Settings window. Add the paths to the bone analysis modules under Additional module paths: (Figure 2).
		<ol>
			<li>To do this, drag and drop the following list of folders onto the box located under Additional module paths:. These folders are located inside of the downloaded folder in step 1.3.1: AutoMask, CorticalBreakDetection, ErosionComparison, ErosionVolume, FileConverter, ImageRegistration, Training. Settings window should resemble Figure 2.</li>
			<li>Press OK on the bottom right of the Settings window. A restart is required to confirm the installation of the modules. Do this by closing 3D Slicer and relaunching it. 
			&#8203;NOTE: Loading the modules is only done once per installation of 3D Slicer. Upon further updates to the bone analysis GitHub repository, a simple terminal (or command line) git pull command at the directory containing the earlier BAM download will automatically update all the modules. Again, alternatively, the repository can be downloaded, and old modules exchanged with the new ones manually.</li>
		</ol>
		</li>
	</ol>
	</li>
</ol>
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/65802/65802fig02.jpg" /> 
Figure 2: Example of settings window after adding bone analysis modules to an installation of 3D Slicer. The image shows a screenshot of the settings window with the modules highlighted in the red box. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig02large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
2. Training module
<ol>
	<li>Launch the BAM-Training module.
	<ol>
		<li>Click on the Drop-down Menu located on 3D Slicer&#39;s toolbar. Find bone analysis modules and hover the mouse above it (Figure 3). Click on Training.</li>
	</ol>
	</li>
	<li>Load files in the module.
	<ol>
		<li>Upon launching the BAM training module, all the required files (greyscale images, masks, reference erosion segmentations) will be loaded automatically by clicking Proceed, assuming the BAM github repository was downloaded as mentioned above.</li>
	</ol>
	</li>
	<li>Choose a scan type for the files.
	<ol>
		<li>Choose one by hovering over the drop-down menu labeled Input Volume: Select a Volume, this represents the master grey scale image.</li>
		<li>Choose the mask (i.e., the file that identifies the volume within the periosteal surface) in the drop-down menu labeled Input Mask: Select a Volume. Make sure this mask corresponds to the input volume above by verifying the measurement ID and the MCP joint is the same in both selections.</li>
		<li>If this is the first time running the training module on this image with this launch of 3D Slicer, then create a new output segmentation at the drop-down menu labeled Output Erosions: Select a Segmentation. To do this, click the drop-down menu and select Create New Segmentation. This will create a new output segmentation node labeled after the input mask label + _ER. To give the output a different label, select Create New Segmentation As&#8230; instead and input the desired label. 
		NOTE: In 3D Slicer and this document, mask and segmentation identifies the volume inside the bone&#39;s periosteal surface. The mask is visualized as a binary image, while the segmentation refers to the visualization of the binary image overlaid with the grey scale image. These distinctions are made by 3D Slicer. An example is illustrated in Figure 4.</li>
	</ol>
	</li>
	<li>Place seed points as described below.
	<ol>
		<li>To begin, create a new seed point list to add seed points. To do this, click on the drop-down menu labeled Seed Points: None and create a new list by selecting Create new Point List. Again, the default labeling standard is input image label + _SEEDS. To provide your own label, select Create New Point List&#8230;.</li>
		<li>Scroll through the slices and identify erosion sites by placing a seed point in the region of interest. Press the Red Dot-Blue Drop button shown in Figure 5A to add a new seed point.
		<ol>
			<li>Place the seed point as deep (inwards into trabecular bone) into the erosion volume as possible. Make sure the seed point is placed on the darkest region of the volume.</li>
			<li>To change the seed point size, modify the percentage size at the text box labeled Seed Point Size:. Other fields in the seed points table, such as bone and cortical interruption, are for the user&#39;s records and do not affect the erosion computation algorithm.</li>
		</ol>
		</li>
	</ol>
	</li>
	<li>Obtain feedback as described below.
	<ol>
		<li>Once the seed points have been placed. Press the button labeled Get Erosions, highlighted in Figure 5B, to run the erosion measurement algorithm on the given inputs. Upon completion of the erosion measurements, the module will provide feedback on the seed point placement. Each seed point&#39;s location is compared with the location of reference erosions to match seed points to the erosion it is trying to measure.</li>
		<li>Obtain reference erosions by calculating the erosion volume using seed points placed by rheumatologists with training, extensive publication records and more than 10 years of experience using HR-pQCT imaging and erosion analysis (SF and CF).</li>
	</ol>
	</li>
</ol>
<img alt="Figure 3" class="xfigimg" src="/files/ftp_upload/65802/65802fig03.jpg" /> 
Figure 3: 3D Slicer&#39;s dropdown menu. The dropdown menu to find the bone analysis modules and select the training module. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig03large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 4" class="xfigimg" src="/files/ftp_upload/65802/65802fig04.jpg" /> 
Figure 4: Identification of the volume inside the bone&#39;s periosteal surface. (A) Example of a mask. The mask is visualized as a binary image. (B) Example of a segmentation. The segmentation refers to the visualization of the binary image overlaid with the grey scale image. These distinctions are made by 3D Slicer. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig04large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 5" class="xfigimg" src="/files/ftp_upload/65802/65802fig05.jpg" /> 
Figure 5: Example screen shot of training module within 3D Slicer. (A) Click to add new seed points. (B) Click to compute erosion volumes. (C) Click to import images. (D) Click to reveal seed points placed by experts. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig05large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
3. Image acquisition and export to use in erosion analysis tool
<ol>
	<li>Acquire HR-pQCT images using a first or second-generation HR-pQCT scanner. A commercial scanner was used to acquire the images for this study (see Table of Materials). 
	NOTE: The images used in this study are of the 2nd and 3rd metacarpophalangeal joints and were acquired using the protocol described in Barnabe et al.8, however images of any joints with erosions are compatible with BAM.</li>
	<li>Inspect images for motion artifact16,17. Do not use images with motion scores &#62; 3 for erosion analysis.</li>
	<li>Export AIM (proprietary image format) or digital imaging and communications in medicine (DICOM) files of each joint to a local disk using file transfer protocol (FTP). Files of individual joints may be generated using the joint space width (JSW) analysis pipeline provided by the manufacturer18. Rename files from default number format for easier use.</li>
</ol>
4. File conversion and bone mask generation
NOTE: Depending on the image format, follow step 4.1 for AIM (HR-pQCT proprietary image format), MHA (ITK MetaImage format), nii (NIfTI - Neuroimaging Informatics Technology Initiative), NRRD (Nearly Raw Raster Data) images or step 4.2 for DICOM images.
<ol>
	<li>To import images with any of the following image file formats: MHA, nii, AIM or NRRD follow the steps described below.
	<ol>
		<li>Click on the button labeled DATA located at the top left corner of the 3D Slicer window (Figure 5C).</li>
		<li>To add image files, click on Choose File(s) to Add, locate and add the images.</li>
		<li>To add an entire directory of images, click on Choose Directory to Add, locate and add the directory. This will load all images in that directory.</li>
		<li>If an image mask needs to be imported as a 3D Slicer segmentation for any reason, first convert to an NRRD or nii file. This conversion can be done automatically, see step 4.4.1 for details.</li>
	</ol>
	</li>
	<li>Import DICOM file(s) in 3D Slicer as described below.
	<ol>
		<li>Click on the button labeled DCM located at the top left corner of the 3D Slicer window.</li>
		<li>Click on Import DICOM Files, locate and add the directory containing the DICOM files (extension is .dcm).</li>
		<li>Click on the button labeled Load located at the right side of the window.</li>
	</ol>
	</li>
	<li>Get image mask using Step 2 - Automatic Mask in the BAM - Automatic Mask module.
	<ol>
		<li>Click on the drop-down menu located on 3D Slicer&#39;s toolbar. Find Bone Analysis Modules and hover the mouse cursor above it. Click on Automatic Mask.</li>
		<li>Under the tab Step 2 - Automatic Mask, select an input volume using the drop-down menu labeled Input Volume:. This is the input scan.</li>
		<li>Create a new output at the drop-down menu labeled output segmentation: and select Create New LabelMapVolume. This will create a new output node labeled after the input mask label + _MASK. To give the output a different label, instead select Create New LabelMapVolume as&#8230; and input the desired label.</li>
		<li>Input the number of bones to be masked at the text box with that label. Select Ormir in the drop-down menu labeled Algorithm for the optimal segmentation for this analysis19. 
		NOTE: Other options for generating these masks are available and may be added in the future.</li>
		<li>Click on Get Mask. This will run the algorithm (~2-3 min) and output the result at the same directory of the input image. It will also save a separate mask for each bone if the image had multiple bones.</li>
	</ol>
	</li>
	<li>Perform manual correction of bone mask using Step 3 - Manual Correction in the BAM module. Often the mask generated is not accurate. Perform manual correction to add, delete, or edit specific components of the segmentations.
	<ol>
		<li>To edit a mask that was generated through other means or generated in a previous run of 3D Slicer, use this module to load these masks to 3D Slicer from a file. The file extension can be any of the following, MHA, nii, NRRD, AIM.
		<ol>
			<li>Copy the images to the LOAD_MASKS directory located in the BAM folder downloaded in step 1.3.</li>
			<li>Go back to 3D Slicer and press the button labeled Load in the manual correction stage.</li>
		</ol>
		</li>
		<li>Select the segmentation to be corrected in the drop-down menu labeled Mask To Be Corrected:&#34;.</li>
		<li>Select the original gray-scale image belonging to this erosion segmentation in the drop-down menu labeled Master Volume:. Press Initialize.</li>
		<li>Each segmentation must have its own entry in the table below. Select the segmentation to be corrected based on the color of the segmentation.</li>
		<li>To add to a segmentation, click on the second button on the first row. This uses the paint function. Make additions to the volumes by drawing on the images (hold left mouse button down and move the mouse).</li>
		<li>To remove part of the segmentation, click on the button below the table labeled Erase Between Slices. This is the erase function and works like the paint function but erases instead.</li>
		<li>Draw additions as needed on roughly every 10-25 slices, but make sure to include the first slice and last slice where an addition was needed.</li>
		<li>If the paint function was used, the changes can be interpolated by clicking on the first button of the fifth row labeled Fill in Between Slices function. Click on the buttons Initialize &#62; Apply.</li>
		<li>If the erase function was used, simply click on the button below the table labeled Apply Erase. Do not use both paint and erase functions at the same time. Apply one function first then apply the other.</li>
		<li>After the edits are completed, press Apply.</li>
	</ol>
	</li>
</ol>
5. Identification of erosions
<ol>
	<li>Use Step 4 -&#160;Erosions in the BAM - Erosion Volume&#160;module for identification of erosion. The erosion volume module is the tool responsible for identifying and measuring erosions within a scan. 
	NOTE: This module is the focus of the training tool detailed above and has a nearly identical workflow. The differences are that the computed erosions are not compared against expertly annotated ones, exporting erosion statistics and manual correction of the volumes after their identification is possible here.</li>
	<li>Place seed points and get erosion as done in step 2.4. In the end no feedback will be provided.</li>
	<li>Manual Correction
	<ol>
		<li>If the size and shape of the automatically detected erosion volumes are unsatisfactory, edit these under the tabs labeled Step 5 - Manual Correction and Export Segmentation. Follow steps outlined in step 4.4. However, there is no option to load external erosion volumes. Do not press Apply after finishing the corrections as the changes have already been saved.</li>
	</ol>
	</li>
</ol>
6. Erosion Statistics
<ol>
	<li>Export the computed data to a spreadsheet file (CSV format) using the tab labeled Step 6 - Statistics.</li>
	<li>Provide the erosion volume computed in Step 4 and optionally corrected in Step 5 under the drop-down menu labeled Input Erosions.</li>
	<li>Provide the greyscale image under the drop-down menu labeled Master Volume. Provide the voxel width, in mm, of the image in the text box. Press Get Statistics.</li>
	<li>The spreadsheet file has been generated in the directory called EROSIONS_OUTPUT_DATA located in the BAM folder downloaded in step 1.3. See Table 1 for an example of the output table.</li>
</ol>

Identification of Bone Erosions in HR-pQCT Images in Rheumatoid Arthritis

<ol>
	<li>Schett, G., Gravallese, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Bone+erosion+in+rheumatoid+arthritis:+mechanisms,+diagnosis+and+treatment.">Bone erosion in rheumatoid arthritis: mechanisms, diagnosis and treatment.</a> Nature Reviews Rheumatology. 8 (11), 656-664 (2012).</li><li>&#216;deg&#229;rd, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Association+of+early+radiographic+damage+with+impaired+physical+function+in+rheumatoid+arthritis:+A+ten-year,+longitudinal+observational+study+in+238+patients.">Association of early radiographic damage with impaired physical function in rheumatoid arthritis: A ten-year, longitudinal observational study in 238 patients.</a> Arthritis &amp; Rheumatism. 54 (1), 68-75 (2006).</li><li>Scott, D. L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+links+between+joint+damage+and+disability+in+rheumatoid+arthritis.">The links between joint damage and disability in rheumatoid arthritis.</a> Rheumatology. 39 (2), 122-132 (2000).</li><li>van Nies, J. A. B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evaluating+processes+underlying+the+predictive+value+of+baseline+erosions+for+future+radiological+damage+in+early+rheumatoid+arthritis.">Evaluating processes underlying the predictive value of baseline erosions for future radiological damage in early rheumatoid arthritis.</a> Annals of Rheumatic Diseases. 74 (5), 883-889 (2015).</li><li>Versteeg, G. A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Early+radiological+progression+remains+associated+with+long-term+joint+damage+in+real-world+rheumatoid+arthritis+patients+treated+to+the+target+of+remission.">Early radiological progression remains associated with long-term joint damage in real-world rheumatoid arthritis patients treated to the target of remission.</a> Scandinavian Journal of Rheumatology. , (2021).</li><li>Brunet, S. C., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Bone+changes+in+early+inflammatory+arthritis+assessed+with+High-Resolution+peripheral+Quantitative+Computed+Tomography+(HR-pQCT):+A+12-month+cohort+study.">Bone changes in early inflammatory arthritis assessed with High-Resolution peripheral Quantitative Computed Tomography (HR-pQCT): A 12-month cohort study.</a> Joint Bone Spine. 88 (1), 105065 (2021).</li><li>Finzel, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Repair+of+bone+erosions+in+rheumatoid+arthritis+treated+with+tumour+necrosis+factor+inhibitors+is+based+on+bone+apposition+at+the+base+of+the+erosion.">Repair of bone erosions in rheumatoid arthritis treated with tumour necrosis factor inhibitors is based on bone apposition at the base of the erosion.</a> Annals of Rheumatic Diseases. 70 (9), 1587-1593 (2011).</li><li>Barnabe, C., Feehan, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=High-resolution+peripheral+quantitative+computed+tomography+imaging+protocol+for+metacarpophalangeal+joints+in+inflammatory+arthritis:+the+SPECTRA+collaboration.">High-resolution peripheral quantitative computed tomography imaging protocol for metacarpophalangeal joints in inflammatory arthritis: the SPECTRA collaboration.</a> The Journal of Rheumatology. 39 (7), 1494-1495 (2012).</li><li>Peters, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Assessment+of+Cortical+Interruptions+in+the+Finger+Joints+of+Patients+With+Rheumatoid+Arthritis+Using+HR-pQCT,+Radiography,+and+MRI.">Assessment of Cortical Interruptions in the Finger Joints of Patients With Rheumatoid Arthritis Using HR-pQCT, Radiography, and MRI.</a> Journal of Bone and Mineral Research. 33 (9), 1676-1685 (2018).</li><li>Scharmga, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Vascular+channels+in+metacarpophalangeal+joints:+a+comparative+histologic+and+high-resolution+imaging+study.">Vascular channels in metacarpophalangeal joints: a comparative histologic and high-resolution imaging study.</a> Scientific reports. 7 (1), 8966-8968 (2017).</li><li>Barnabe, C., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Definition+for+Rheumatoid+Arthritis+Erosions+Imaged+with+High+Resolution+Peripheral+Quantitative+Computed+Tomography+and+Interreader+Reliability+for+Detection+and+Measurement.">Definition for Rheumatoid Arthritis Erosions Imaged with High Resolution Peripheral Quantitative Computed Tomography and Interreader Reliability for Detection and Measurement.</a> The Journal of Rheumatology. 43 (10), 1935-1940 (2016).</li><li>Klose-Jensen, R., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=High-Resolution+Peripheral+Quantitative+Computed+Tomography+for+Bone+Evaluation+in+Inflammatory+Rheumatic+Disease.">High-Resolution Peripheral Quantitative Computed Tomography for Bone Evaluation in Inflammatory Rheumatic Disease.</a> Frontiers in Medicine. 7, 337 (2020).</li><li>Blavnsfeldt, A. G., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effect+of+radiographic+disease+severity+in+high-resolution+quantitative+computed+tomography+assessment+of+metacarpophalangeal+joint+erosion+and+cysts.">Effect of radiographic disease severity in high-resolution quantitative computed tomography assessment of metacarpophalangeal joint erosion and cysts.</a> International Journal of Rheumatic Diseases. 24 (1), 112-119 (2021).</li><li>Zhao, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Open-source+image+analysis+tool+for+the+identification+and+quantification+of+cortical+interruptions+and+bone+erosions+in+high-resolution+peripheral+quantitative+computed+tomography+images+of+patients+with+rheumatoid+arthritis.">Open-source image analysis tool for the identification and quantification of cortical interruptions and bone erosions in high-resolution peripheral quantitative computed tomography images of patients with rheumatoid arthritis.</a> Bone. 165, 116571 (2022).</li><li>Fedorov, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=3D+Slicer+as+an+image+computing+platform+for+the+Quantitative+Imaging+Network.">3D Slicer as an image computing platform for the Quantitative Imaging Network.</a> Magnetic Resonance Imaging. 30 (9), 1323-1341 (2012).</li><li>Pauchard, Y., Liphardt, A. -. M., Macdonald, H. M., Hanley, D. A., Boyd, S. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Quality+control+for+bone+quality+parameters+affected+by+subject+motion+in+high-resolution+peripheral+quantitative+computed+tomography.">Quality control for bone quality parameters affected by subject motion in high-resolution peripheral quantitative computed tomography.</a> Bone. 50 (6), 1304-1310 (2012).</li><li>Sode, M., Burghardt, A. J., Pialat, J. -. B., Link, T. M., Majumdar, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Quantitative+characterization+of+subject+motion+in+HR-pQCT+images+of+the+distal+radius+and+tibia.">Quantitative characterization of subject motion in HR-pQCT images of the distal radius and tibia.</a> Bone. 48 (6), 1291-1297 (2011).</li><li>Stok, K. S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Consensus+approach+for+3D+joint+space+width+of+metacarpophalangeal+joints+of+rheumatoid+arthritis+patients+using+high-resolution+peripheral+quantitative+computed+tomography.">Consensus approach for 3D joint space width of metacarpophalangeal joints of rheumatoid arthritis patients using high-resolution peripheral quantitative computed tomography.</a> Quantitative imaging in medicine and surgery. 10 (2), 314-325 (2020).</li><li>. Open and Reproducible Musculoskeletal Imaging Research Available from: <a target="_blank" href="https://github.com/SpectraCollab/ORMIR_XCT">https://github.com/SpectraCollab/ORMIR_XCT</a> (2023)</li><li>Finzel, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+and+Change+in+Erosion+Measurements+by+High-resolution+Peripheral+Quantitative+Computed+Tomography+in+a+Longitudinal+Dataset+of+Rheumatoid+Arthritis+Patients.">Reliability and Change in Erosion Measurements by High-resolution Peripheral Quantitative Computed Tomography in a Longitudinal Dataset of Rheumatoid Arthritis Patients.</a> The Journal of Rheumatology. 48 (3), 348-351 (2021).</li><li>T&#246;pfer, D., Finzel, S., Museyko, O., Schett, G., Engelke, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Segmentation+and+quantification+of+bone+erosions+in+high-resolution+peripheral+quantitative+computed+tomography+datasets+of+the+metacarpophalangeal+joints+of+patients+with+rheumatoid+arthritis.">Segmentation and quantification of bone erosions in high-resolution peripheral quantitative computed tomography datasets of the metacarpophalangeal joints of patients with rheumatoid arthritis.</a> Rheumatology (Oxford). 53 (1), 65-71 (2014).</li><li>Peters, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Reliability+of+a+Semi-automated+Algorithm+for+Detection+of+Cortical+Interruptions+in+Finger+Joints+on+High+Resolution+CT+Compared+to+MicroCT.">The Reliability of a Semi-automated Algorithm for Detection of Cortical Interruptions in Finger Joints on High Resolution CT Compared to MicroCT.</a> Calcified tissue international. , 1-9 (2017).</li><li>Zhang, X., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automatic+3D+joint+erosion+detection+for+the+diagnosis+and+monitoring+of+rheumatoid+arthritis+using+hand+HR-pQCT+images.">Automatic 3D joint erosion detection for the diagnosis and monitoring of rheumatoid arthritis using hand HR-pQCT images.</a> Computerized Medical Imaging and Graphics. 106, 102200 (2023).</li></ol>

All authors have no conflict of interest to report.

This training tool provides an opportunity to learn to identify erosions using the bone analysis module. Further use of this erosion analysis tool beyond training requires access to good quality images, with little or no motion artifact. The HR-pQCT erosion definition based on the literature describes anatomical features associated with pathological erosions that can be reported with reasonable reproducibility11,20. However, this definition does not account for common anatomical locations of vascular channels, potentially resulting in their misclassification as bone erosions10.
The critical steps in this protocol are the generation of the bone mask, the placement of the seed points, and the generation of the erosion volume. While automated methods to generate the masks and erosion volume are implemented, the masks often require manual correction to ensure satisfactory results. A comprehensive description of the tools available to perform the manual corrections is provided. The placement of seed points is guided by the training examples provided by the BAM-Training module.
Based on the data utilized to date, this protocol provides suggestions for troubleshooting when the erosion analysis module does not produce the expected results. In future work, access to additional training data will be provided. A previous study showed that the erosion volumes assessed with this method are comparable with existing methods14,21,22. Provision of training data will allow comparison to newer erosion analysis tools as they are developed23.
The training tool introduced here primarily aids with erosion identification; however, the method is currently limited by the lack of a consensus on defining the extent of an erosion in the trabecular bone. Nonetheless, the BAM modules are open source, thus, as future definitions of erosion extent change, other researchers have access to modify the modules to meet their needs.
As the use of HR-pQCT in rheumatological research expands, the training tool provides inexperienced users with guidance on identifying pathological cortical interruptions on HR-pQCT images for erosion analysis. This tool will be applicable to researchers regardless of the method selected for erosion analysis. While completely automated erosion identification is desirable to improve reproducibility and speed of analysis, large reference/benchmark datasets with accurate annotations are required to train machine learning models. As an open-source tool, this module provides an opportunity to collectively develop large, annotated datasets for future use in machine learning. The use of this training tool will enable more researchers to include erosion analysis in their HR-pQCT research.

Bone erosions occur when inflammation causes localized bone loss at the cortical bone surface. These erosions extend into the underlying trabecular bone region. They are a pathological feature of several forms of inflammatory arthritis, including rheumatoid arthritis (RA)1. Erosion presence and size are associated with poor outcomes, patient function, and disease progression2,3,4,5. While plain radiography remains the clinical standard for erosion assessment, high-resolution peripheral quantitative computed tomography (HR-pQCT) provides 3D images and superior sensitivity and specificity for erosion detection6,7. For inflammatory arthritis, such as RA, HR-pQCT is commonly performed on the 2nd and 3rd metacarpophalangeal joints - the most affected joints of the hand8. Because HR-pQCT images have high spatial resolution, physiological interruptions in the cortical surface are also observed in healthy individuals without RA9. These cortical interruptions are often associated with vascular channels or nutrient foramen passing through the bone10. Thus, the challenge is to distinguish cortical interruptions associated with a disease process (i.e., pathological erosions) from non-pathological features.
The consensus definition of a pathological bone erosion was published by the Study grouP for xtrEme Computed Tomography in Rheumatoid Arthritis (SPECTRA) as the presence of a definite interruption in the cortical layer of the bone that extends over at least two consecutive slices and is detectable in two or more perpendicular planes11. Further, the interruption must be non-linear in shape and accompanied by a loss in the trabecular region. Visual examples of cortical interruptions that do and do not meet the criteria of erosions are shown in Klose-Jensen et al.12.
However, not all cortical interruptions that meet the above criteria are classified as erosions. Interruptions are sometimes caused by physiological processes such as vascular channels (Figure 1). These can be identified and differentiated from erosions due to their predictable anatomical locations, parallel and straight margins and sub-millimetric size13. Cysts are another form of cortical interruption that is not considered to be an erosion. They often have a rounded trabecular structure with a clear cystic wall 13. In contrast to the sharp edges and open trabecular structure displayed by erosions. However, it is possible for erosions to form within cystic sites, making it ambiguous to delineate the volume of bone loss caused by the erosions and not the cysts. While resolving this ambiguity with further criteria is not the purpose of this study, there is a need to provide comprehensive examples of pathological erosion and physiological cortical interruptions.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/65802/65802fig01.jpg" /> 
Figure 1: Example of cortical interruptions that were not caused solely by erosions. (A) A drawing illustrating the common location of vascular channels at the base of the metacarpal head. Examples of vascular channels in (B) coronal, (C) sagittal, (D) and (E) axial planes. (F) Example of a cortical interruption caused by a cyst. (G) Example of a void volume within trabecular region of the bone involving both cysts and erosions. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig01large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
Despite the challenges in erosion identification, there are currently no training tools in place to provide less experienced users with guidance on interpreting HR-pQCT images for erosion analysis. Recently, an open-source module for erosion analysis called bone analysis module (BAM) - Erosion Volume was developed, implemented as an extension to an open-source image processing software to enable erosion visualization and volumetric analyses14. The protocol presented here describes the use of a training module added to BAM (BAM - Training), which compares a users&#39; erosion identification attempts by comparing the erosion identification with erosions annotated by expert rheumatologists. This training tool provides users with feedback on erosion identification in order to guide improvements in erosion analysis. Software installation instructions are provided in step 1. For new data acquisition, see steps 3 - 5.3. For training module use only, see step 2.

<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td>3DSlicer</td>
			<td>Open Source</td>
			<td>N/A</td>
			<td>Download at https://www.slicer.org/</td>
		</tr>
		<tr>
			<td>BAM Erosion Analysis Modules</td>
			<td>Open Source</td>
			<td>N/A</td>
			<td>Version used in manuscript: download at https://doi.org/10.5281/zenodo.7943007</td>
		</tr>
		<tr>
			<td>XtremeCTII</td>
			<td>Scanco Medical&#160;</td>
			<td>N/A</td>
			<td></td>
		</tr>
	</tbody>
</table>

erosion identification in metacarpophalangeal joints in rheumatoid arthritis using high-resolution peripheral quantitative computed tomography

Bone erosions are a pathological feature of several forms of inflammatory arthritis including rheumatoid arthritis (RA). The increased presence and size of erosions are associated with poor outcomes, joint function, and disease progression. High-resolution peripheral quantitative computed tomography (HR-pQCT) provides unparalleled in vivo visualization of bone erosions. However, at this resolution, discontinuities in the cortical shell (cortical breaks) that are associated with normal physiological processes and pathology are also visible. The Study grouP for xtrEme Computed Tomography in Rheumatoid Arthritis previously used a consensus process to develop a definition of pathological erosion in HR-pQCT: a cortical break detected in at least two consecutive slices, in at least two perpendicular planes, non-linear in shape, with underlying trabecular bone loss. However, despite the availability of a consensus definition, erosion identification is a demanding task with challenges in inter-rater variability. The purpose of this work is to introduce a training tool to provide users with guidance on identifying pathological cortical breaks on HR-pQCT images for erosion analysis. The protocol presented here uses a custom-built module (Bone Analysis Module (BAM) - Training), implemented as an extension to an open-source image processing software (3D Slicer). Using this module, users can practice identifying erosions and compare their results to erosions annotated by expert rheumatologists.

Author Spotlight: Enhancing Rheumatoid Arthritis Research Through HR-pQCT Imaging Analysis 

Erosion Identification in Metacarpophalangeal Joints in Rheumatoid Arthritis using High-Resolution Peripheral Quantitative Computed Tomography

One of our goals as part of the study group for extreme computed tomography in RA or spectra, is to develop better image analysis tools to understand bone damage in rheumatoid arthritis. Applying high resolution peripheral quantitative computed tomography, or HRPQCT for short, to rheumatoid arthritis, researchers have shown that this modality is far more sensitive than standard X-rays to detect bone erosions and have detected bone changes in response to treatment in as little as three months. One of the major challenges is accurately identifying bone erosions in HRPQCT images.Most researchers rely on expert rheumatologists with extensive training. The analysis, while powerful, is also very time consuming. Our group has developed a new open source software module that can be used to analyze bone erosions in HRPQCT images of rheumatoid arthritis patients.We have shown that the results are comparable to previously established methods. Implementation of this module will allow us to more efficiently investigate the effects of altered treatments and subclinical inflammation on bone damage progression in rheumatoid arthritis.

Using the training tool, users can practice identifying erosion sites while receiving feedback on their results. This feedback loop can improve the user&#39;s ability to identify erosions and potentially use the BAM modules to identify erosions on their own images. Feedback after seed point placement is based on the following criteria. 1) If the number of seed points placed does not match the number of reference erosions, the user is then prompted to delete or add the appropriate number of seed points. 2) If the seed point location cannot be matched with a reference erosion, feedback stating that no erosion exists at that seed point&#39;s location is displayed. 3) If a seed point is matched with a reference pathological/physiological cortical interruption such as a cyst or a vascular channel, the user is informed about the type of cortical interruption they attempted to identify as an erosion and is asked to remove the seed point. 4) If the location of the seed point overlaps a reference erosion, the algorithm may still not detect the erosion. This may occur when the seed point has not been centered in the erosion. In these cases, the user is prompted to adjust the position of the seed point. 5) If a seed point is placed too far from any erosion, the user is informed of their incorrect placement and encouraged to try again. 6) When a seed point location matches the reference erosion, a prompt is displayed informing the user of their successful attempt to identify the erosion at that specific seed point.
The following section illustrates examples of how the module works based on different inputs. Correct and incorrect inputs will be demonstrated in the following examples. Figure 6A shows the seed point location which is located within the erosion. Only one erosion exists within this image, therefore computing the erosions with the seed point will yield the expected results. Figure 6B shows the prompt displayed to users when their attempt to identify the erosions matches the expertly annotated image. The module also displays the results as segmentations on the grey-scale image (Figure 6C). If the user placed a seed point at a location without an erosion, such as Figure 7A, the module would display an error prompt (Figure 7B) stating that no erosion exists at this location and suggests that the user relocate/remove the seed points.
<img alt="Figure 6" class="xfigimg" src="/files/ftp_upload/65802/65802fig06.jpg" /> 
Figure 6: Example of correct erosion identification. (A) Example of a user correctly placing a seed point within the erosion site. (B) Example of feedback prompt when all erosions were identified correctly. (C) Example of displayed erosion segmentation when an erosion is computed correctly. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig06large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 7" class="xfigimg" src="/files/ftp_upload/65802/65802fig07.jpg" /> 
Figure 7:&#160;Example of incorrect erosion identification. (A) Example of a seed point placed where no erosion exists. (B) Example of an error prompt when a seed point is placed at a location that has no erosion. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig07large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
The locations of all cysts and vascular channels on the training images provided have been identified by an expert. Therefore, it is possible to detect when a user attempts to incorrectly identify a cyst or a vascular channel. Figure 8A illustrates an attempt to identify a cyst by placing a seed point on it. Figure 8B is the subsequent displayed error prompt.
<img alt="Figure 8" class="xfigimg" src="/files/ftp_upload/65802/65802fig08.jpg" /> 
Figure 8:&#160;Example of cyst identification. (A) Example of a seed point placed on a cyst. (B) Example of an error prompt when a seed point is placed on a cyst. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig08large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
The module will also inform the user if they have the right amount of seed points. If the user placed an incorrect number of seed points, the module would inform the user of the exact amount of seed points that are missing or extra to identify all erosions on the image. The module also gives feedback for each placed seed point. Therefore, the user knows what actions to take for each individual seed point. Figure 9 demonstrates an example where a user only placed one seed point when two were expected.
<img alt="Figure 9" class="xfigimg" src="/files/ftp_upload/65802/65802fig09.jpg" /> 
Figure 9: Example of erosions computed while missing one seed point. The example demonstrates an example where the user only placed one seed point when two were expected. <a href="https://www.jove.com/files/ftp_upload/65802/65802fig09large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
If a user has trouble finding any or all the erosions, they have an option to reveal the expertly annotated locations by pressing a button labeled Reveal Correct Seed Points (Figure 5D). When pressed, this button will load the correct seed points on to the current 3D Slicer window.
In summary, this shows that the software module can assess the correctness of the user&#39;s attempt to identify erosions in the select images by comparing the computed erosion with expertly annotated erosions. In addition, the module provides feedback based on each user-placed seed point to guide them towards the expected seed point location and input parameters.
<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td>Scan ID</td>
			<td>Cortical Interruption</td>
			<td>Bone</td>
			<td>Label</td>
			<td>Centroid Location</td>
			<td>Volume (mm3)</td>
			<td>Surface Area (mm2)</td>
			<td>Roundness</td>
			<td>Number of voxels (voxels)</td>
		</tr>
		<tr>
			<td>3_Training.nii</td>
			<td>Erosion</td>
			<td>Metacarpal</td>
			<td>SEEDS_28-1</td>
			<td>210, 108, 242</td>
			<td>3.321668853</td>
			<td>14.46818378</td>
			<td>0.74411491</td>
			<td>14853</td>
		</tr>
		<tr>
			<td>3_Training.nii</td>
			<td>Erosion</td>
			<td>Metacarpal</td>
			<td>SEEDS_28-3</td>
			<td>179, 100, 241</td>
			<td>1.100739562</td>
			<td>7.121231239</td>
			<td>0.7239659</td>
			<td>4922</td>
		</tr>
	</tbody>
</table>
Table 1: Example of a generated output file (csv format) describing computed erosions and their statistics.

Watch this Scientific Journal Video about Enhancing Rheumatoid Arthritis Research Through HR-pQCT Imaging Analysis at JoVE.com

Bone erosions are an important pathological feature of rheumatoid arthritis. The purpose of this work is to introduce a training tool to provide users with guidance on identifying pathological cortical breaks on high resolution peripheral quantitative computed tomography images for erosion analysis.

Bone erosions are a pathological feature of several forms of inflammatory arthritis including rheumatoid arthritis (RA). The increased presence and size ...

erosion-identification-metacarpophalangeal-joints-rheumatoid

Research

JoVE Journal

Medicine

Training 3D Slicer and Bone Analysis Modules for Bone Erosion Point Identification in Rheumatoid Arthritis Patients

To begin, launch the 3D Slicer software, then launch the training module on the 3D Slicer's toolbar. Click on the dropdown menu to locate the bone analysis modules and hover the mouse above it, then click on training. Click Proceed to load all necessary files.Next, hover over the input volume and select the volume dropdown menu and select a scan type. Choose the mask from the input mask select a volume dropdown menu. Verify the input volume against the measurement ID and the metacarpophalangeal joint in both sections.Click on output erosions select a segmentation to create a new output segmentation. Then click the dropdown menu and select Create New Segmentation. Now click on the dropdown menu labeled Seed Points None, and then choose Create New Point List to create a new seed point.Scroll through the slices, pinpoint erosion sites, and press the red dot blue drop button to place the seed point in the corresponding area of interest. To change the seed point size, modify the percentage size in the text box labeled Seed Point Size. To reorient the image to the location of the seed point in the other two planes, hold down the Shift button as the cursor is being used to move the seed point.After placing the seed points, click on the Get Erosions button to initiate the erosion measurement algorithm. When the measurements are complete, the module will provide feedback on the seed point placement. The module showed that erosion identification against expertly annotated images resulted in accurate feedback and segmented grayscale image.However, incorrect seed point placement results in an error prompt indicative of no erosion. The module also accurately identified cysts when a seed point was placed on it. Wrong seed placement on the cyst resulted in a corresponding error prompt.An insufficient number of seed point placements also resulted in corresponding error prompt.

Bone Mask Generation from 3D Slicer Generated File and Statistical Analysis of Identified Bone Erosion in Rheumatoid Arthritis Patients

To begin, launch the 3D Slicer software. For image input of the identified bone erosion sites, click on the button labeled Data on the 3D Slicer window. Then press Choose Files to add and locate individual images to add the files.To import an entire directory of images at once, press the Choose Directory to Add option, then search and insert the preferred directory. Next, click on the dropdown menu of the 3D Slicer's toolbar. Hover the cursor over the bone analysis modules and click on Automatic Mask.Under the tab Step 2 Automatic Mask, choose an input volume from the input volume dropdown menu. Select Create New Label Map Volume in the output segmentation dropdown menu. If another output label is preferred, click on Create New Label Map Volume As and provide the desired label.Input the number of bones to be masked in the given text box, then select ORMR or Dual Threshold from the algorithm dropdown menu. Click on Get Mask to run the algorithm and output a result in the corresponding image directory. If the image contains multiple bones, a separate mask will be saved for each one.To import a binary mask onto 3D Slicer, copy the mask files onto the load masks directory located in the BAM folder. Go back to the 3D Slicer window and click on the tab Step 3 Manual Correction. To load the mask files and automatically convert them to slicer segmentations, click on Load.To make changes to the mask, use the tools provided in the manual correction tab. To start statistical analysis, click on the erosion volume module from the dropdown menu on the toolbar. Load an image and its corresponding mask.Select the input image and mask, create an output segmentation, and place the seed points on the erosion. Click on the Get Erosions button to initiate the erosion measurement algorithm. If the size and shape of automatically detected erosion volumes are unsatisfactory, manually edit them under the tab Step 5 Manual Correction.Now click on the tab labeled Step 6 Statistics to export the computer data into a spreadsheet file. Next, input the erosion volume in the dropdown menu labeled Input Erosions. Now provide the gray scale image and its voxel width in millimeters in the text box under the master volume menu.Click on Get Statistics to generate a spreadsheet file in the Erosions Output Data Directory located in the BAM folder.