whole-lung 3d reconstruction using medical image processing technology

Enhancing Pulmonary Nodule Diagnosis Using Whole-Lung 3D Reconstruction

Early multiple pulmonary nodules, which are small, round growths on the lung, can be benign or malignant1,2,3. Although solitary pulmonary nodules are easier to diagnose and treat, patients with early multiple pulmonary nodules face significant diagnostic and treatment challenges. To develop effective treatment plans, it is essential to accurately identify the spatial distribution, size, location, and relationship with surrounding lung tissue of these nodules throughout the whole lung4,5. Traditional diagnostic methods have limitations in accurately identifying early multiple pulmonary nodules.
Recent advancements in medical image processing technology and machine learning algorithms have the potential to improve the accuracy and efficiency of early pulmonary nodule detection and diagnosis. Various approaches have been proposed, such as pattern recognition methods based on machine vision and visualization methods based on maximum intensity projection (MIP)6,7,8,9,10. However, these methods suffer from limitations such as false positives, false negatives11,12,13,14,15, and lack of macroscopic and holistic descriptions of the distribution and spatial features of early multiple pulmonary nodules.
To address these limitations, this study proposes a whole-lung 3D reconstruction method that utilizes medical image processing technology to extract the 3D contour of the lung against the background of the whole chest scan. The method then performs 3D reconstruction of the lung, pulmonary artery, and early multiple pulmonary nodules in 3D space. This approach allows for a more comprehensive and accurate representation of the spatial distribution and radiological features of early multiple nodules throughout the whole lung.
The proposed method involves several key steps. Firstly, the medical images are imported into the 3D image processing software, and the lung region is extracted using a threshold-based segmentation technique. Subsequently, the extracted lung region is separated from the surrounding chest wall and the bony structures of the thoracic vertebrae. The early multiple pulmonary nodules and their relationship with surrounding blood vessels are then reconstructed in 3D space using maximum intensity projection (MIP) algorithms. Finally, the reconstructed 3D model of the lung, pulmonary artery, and nodules is displayed for further analysis.
This method has several advantages over existing methods. Unlike traditional methods that rely on 2D images, this method utilizes 3D volume to provide a more accurate and comprehensive representation of early multiple pulmonary nodules. The method also overcomes the limitations of false positives and false negatives associated with pattern recognition methods and MIP visualization methods. Furthermore, this method provides a macroscopic and holistic description of the distribution and spatial features of early multiple pulmonary nodules, which is essential for developing effective treatment plans.
The proposed method has several potential applications in the diagnosis and treatment of early multiple pulmonary nodules. The accurate identification of the spatial distribution and radiological features of early multiple nodules can aid in the early diagnosis and treatment of lung cancer. Furthermore, the method can be used to monitor the progression of the disease and evaluate the effectiveness of treatment plans.
Pattern recognition methods6,7,8 based on machine vision have shown promise in identifying pulmonary nodules, but suffer from limitations such as false positives and false negatives. MIP visualization methods, on the other hand, provide a more accurate representation of individual nodules, but lack a macroscopic and holistic description of the distribution and spatial features of early multiple nodules. The proposed whole-lung 3D reconstruction method overcomes these limitations and provides a more accurate and comprehensive representation of early multiple pulmonary nodules.
Isovoxel transformation16,17refers to the process of converting 3D images with different voxel sizes into 3D images with uniform voxel sizes. In the field of medical image processing, 3D volumes are often composed of voxels with varying sizes, which can lead to computational and visualization issues. The purpose of isovoxel transformation is to address these issues by resampling and interpolating the voxels in the original 3D volume, resulting in a new 3D image with consistent voxel sizes. This technique finds applications in various medical contexts, including image registration, segmentation, and visualization. Thus, this study proposed a whole-lung 3D reconstruction method that utilizes medical image processing technology to extract the 3D contour of the lung against the background of the whole chest scan. The method provides a more accurate and comprehensive representation of the spatial distribution and radiological features of early multiple nodules throughout the whole lung. This study contributes to the development of more accurate and effective diagnostic and treatment strategies for patients with early multiple pulmonary nodules.

Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer 

Three-Dimensional Reconstruction for the Whole Lung with Early Multiple Pulmonary Nodules

This research develops a 3D modeling approach to comprehensively visualize multiple pulmonary nodules throughout the whole lung, aiming to improve the diagnosis and the treatment of early-stage lung cancer patients. The key questions are how to accurately reconstruct nodule distribution and interplay with lung tissue. Recent advance in deep learning and computer vision enable more accurate AI-assisted detection and segmentation of lung nodules.However, limitation persist regarding whole lung modeling and the spatial relationships between multiple nodules. This research offers progress through a 3D reconstruction technique for the entire lung. Integrating AI-driven medical imaging and visualization with specialist clinical diagnosis and treatment is critical.Technologies like deep learning for segmentation volumetric modeling, virtual augmented reality for 3D visualization and multimodal data fusion are advancing whole lung modeling and multinodule assessment to enhance clinical decision-making. This research establish a effective 3D modeling approach for visualizing the distribution and the spatial relationships of multiple pulmonary nodules across the whole lung volume. Key innovations include lung contour extraction, nodule reconstruction in 3D space, and interactive whole lung visualization.This enables more accurate diagnosis and treatment planning for early-lung cancer patients. Developing a accurate 3D modeling approach for visualizing whole lung nodule patterns provide a new capability for comprehending disease progression. This can enable earlier diagnosis, personalize the treatment plans and improve the outcomes for lung cancer patients.The findings lay the groundwork for expanding whole lung modeling using multimodal data and advancing clinical translation.

Watch this Scientific Journal Video about Whole-Lung 3D Reconstruction Using Medical Image Processing Technology at JoVE.com

Whole-Lung 3D Reconstruction Using Medical Image Processing Technology  

To begin, copy the patient's digital imaging and communications in medicine, or DICOM data, to a defined working directory. Using the file browser, examine each file directory to identify the image sequence with the highest number of scanning layers for analysis. Employ the DICOM function within MATLAB by providing DICOM files as input to extract essential parameters, such as slice thickness and pixel spacing, directly in the MATLAB environment.Then retrieve the location data for each image and access the information via info. SliceLocation in MATLAB workspace. Next, use the slice location function to save the location data into a variable and generate a plot for it.Click the data tips button in the GUI's upper right corner to add data points and enhance the plot. Then use the volume resort function to organize all images and extract the images ranging from the first to the maximum location. Safeguard the volume data from the valid images along with their sorted index.Using the size function in MATLAB examine the three dimensional scale of a 3D volume. To view the 3D volume using the slice view command function, record the sequence scan range obtaining the lungs from 60 to 340. Then use the command to obtain a 3D volume containing all the data of the entire lung.Employ the MATLAB command function DICOM info to obtain the slice thickness of the image sequence. Use the command to calculate the number of Z axes for the isovoxel transformation. Then use the MATLAB command function imresize3 to perform isovoxel transformation on V one, employ the 3D slice view function to view the isovoxel transformed 3D volume.To remove the noise interference, use the data tips button to add continuous data points within the interactive interface. Next, right click on the data tips and select export cursor data to workspace to export the reference boundary for spatial filtering to the MATLAB workspace. Invoke the noise clean function to apply spatial filtering to V two using the input parameter CI from the workspace.Use this slice view command function to visualize the resulting volume. Select a template slice such as the two 32nd image for the image segmentation design and assign it to a variable. Then open the MATLAB image segmenter GUI by executing the image segmenter one command.Select the auto cluster tool from the toolbar at the top and click the left mouse button to execute the command. Next, click the show binary button in the upper right corner to display the image in black and white binary. To make the lung region white, select the invert mask button from the top toolbar and click the left mouse button for the execution of the command.To eliminate the white color outside the lung area, select the clear borders button to the top toolbar and click the left mouse button. Initiate the 3D lung volume function within the MATLAB workspace. Next, select maximize in the dropdown menu in the top right corner of the fourth view.Select MIP projection, and then choose the jet color map from the built-in color maps option below. Once more, invoke the slice view function, but this time input the entire lung's 3D volume. Within the resulting GUI, use the bottom scroll bar to navigate to the region where the dominant lung nodules are situated spanning scans 48 to 70.Use the 3D lung horizon function to conduct a 3D reconstruction of the region of interest, encompassing sections 48 to 70 from the whole lungs 3D volume.

whole-lung-3d-reconstruction-using-medical-image-processing-technology

Research

JoVE Journal

Medicine

197 visualizações.  Beijing University of Chinese Medicine. Para começar, copie as imagens digitais e as comunicações em medicina do paciente, ou dados DICOM, para um diretório de trabalho definido. Usando o navegador de arquivos, examine cada diretório de arquivos para identificar a sequência de imagens com o maior número de camadas de varredura para análise. Utilize a função DICOM dentro do MATLAB fornecendo arquivos DICOM como entrada para extrair parâmetros essenciais, como espessura de fatia e espaçamento de pixels, diretamente no amb...