creating a uav image dataset for the estimation of invasive plant biomass

무인 항공기 원격 감지 데이터에 의한 침입 식물 바이오매스 평가

In this protocol, the proposed method of invasive biomass estimation based on UAV remote sensing and computer vision can reflect the distribution of invasive organisms and predict the degree of invasive biohazard. Estimates of the distribution and biomass of invasive organisms are critical to the prevention and control of these organisms. Once invasive plants invade, they can damage the ecosystem and cause huge economic losses. Quickly and accurately identifying invasive plants and estimating key invasive plant biomass are major challenges in invasive plant monitoring and control. In this protocol, we take Mikania micrantha as an example to explore an invasive plant biomass estimation method based on unmanned aerial remote sensing and computer vision, which provides a new approach and method for the ecological research of invasive plants and promotes the ecological research and management of invasive plants.
At present, the biomass measurement of Mikania micrantha is mainly done by manual sampling1. The traditional methods of biomass measurement need a lot of workforce and material resources, which are inefficient and limited by the terrain; it is difficult to meet the needs of regional biomass estimation of Mikania micrantha. The major advantage of using this protocol is that it provides a method for quantifying regional invasive plant biomass and spatial distribution of invasive plants in a way that does not take into account the sampling limitations of the area and eliminates the need for manual surveys.
UAV remote sensing technology has achieved certain results in plant biomass estimation and has been widely used in agriculture2,3,4,5,6,7, forestry8,9,10,11, and grassland12,13,14. UAV remote sensing technology has the advantages of low cost, high efficiency, high precision, and flexible operation15,16, which can efficiently obtain remote sensing image data in the study area; then, the texture feature and vegetation index of remote sensing image are extracted to provide data support for the estimation of plant biomass in large area. Current plant biomass estimation methods are mainly categorized into parametric and nonparametric models17. With the development of machine learning algorithms, nonparametric machine learning models with higher accuracy have been widely used in remote sensing estimation of plant biomass. Chen et al.18 utilized mixed logistic regression (MLR), KNNR, and random forest regression (RFR) to estimate the aboveground biomass of forests in Yunnan Province. They concluded that the machine learning models, specifically KNNR and RFR, resulted in superior outcomes compared to MLR. Yan et al.19 employed RFR and extreme gradient boosting (XGBR) regression models to assess the accuracy of estimating subtropical forest biomass using various sets of variables. Tian et al.20 utilized eleven machine-learning models to estimate the aboveground biomass of varying mangrove forest species in Beibuwan Bay. The researchers discovered that the XGBR method was more effective in determining the aboveground biomass of mangrove forests. Plant biomass estimation using man-machine remote sensing is a well-established practice, however, the use of UAV for biomass estimation of the invasive plant Mikania micrantha has yet to be reported both domestically and internationally. This approach is fundamentally different from all previous methods of biomass estimation for invasive plants, especially Mikania micrantha.
To sum up, UAV remote sensing has the advantages of high resolution, high efficiency, and low cost. In the feature variable extraction of remote sensing images, texture features combined with vegetation indexes can obtain better regression prediction performance. Nonparametric models can obtain more accurate regression models than parametric ones in plant biomass estimation. Therefore, to calculate the null distribution of invasive plants and their biomass precisely, we suggest the following outlined procedures for the invasive plant biomass experiment that relies on remote sensing using UAVs and computer vision.

저자 스포트라이트: 효율적인 침입 식물 바이오매스 추정을 위한 UAV 원격 감지

침입 식물에 대한 컴퓨터 비전 기반 바이오매스 추정

Our method utilizes UAV remote sensing and computer vision to efficiently estimate invasive plant biomass, overcoming the inefficiencies and subjectivity of traditional manual surveys and data collection in complex environments. Recent advancement in UAV remote sensing for plant biomass estimation include high-resolution imaging and multimodal data integration. These developments enhance scientific research, environmental monitoring, and agricultural management by offering more precise data support.Advancements in UAV remote sensing for plant biomass estimation encompass high-resolution sensors, multispectral hyperspectral imaging, GPS, INS, specialized data processing software, AI and deep learning, improved batteries, enhanced data storage, and cloud computing. Relating to a traditional plant biomass is traditional methods. Our proposed method doesn't require service and data combing and for other multispectral hyperspectral estimation methods, we don't need a special requirement.Our method can accurately estimate a plant's biomass without experience requirement, which is our advantage. Our laboratory will continue to study UAV remote sensors plant biomass estimation. In the future we'll focus on firmware of amazing deep learning algorithms, applying in remotely stored data filtering.Continuing deep research on thrive preference and the sensor technology innovations.

침입 식물 바이오매스 추정을 위한 UAV 이미지 데이터 세트 생성

시작하려면 연구 지역의 토양 샘플링 위치를 결정하기 위해 충분한 바이오매스 샘플로 무작위 샘플링 접근 방식을 사용합니다. 샘플 프레임을 식물 위에 수평으로 배치하여 각 식물 사이에 최소 2미터의 이격 거리로 식물을 완전히 둘러쌉니다. 드론과 카메라를 사용하여 무인 항공기 또는 UAV 원격 감지 촬영 시스템을 구축합니다.UAV를 사용하여 지정된 연구 영역 내에서 경로를 그리려면 먼저 방향 및 측면 겹침 비율을 70%로 설정하고 카메라를 지면에 수직으로 유지하고 고도 30미터에서 2초의 균일한 시간 간격으로 사진을 캡처합니다. 스크립트 파일을 실행하여 바이오매스 추정을 위한 Python 소프트웨어로 후속 처리할 수 있도록 항공 이미지를 저장합니다. Python 프로그래밍을 사용하여 데이터 세트를 만들려면 원시 이미지 데이터를 샘플 이미지와 동일한 크기의 더 작은 이미지로 분할합니다.분할을 위해 슬라이딩 윈도우 방법을 사용하여 수평 및 수직 단계를 280픽셀로 설정합니다. 분할된 작은 이미지에서 880개의 침입 식물 이미지와 1,500개의 배경 이미지를 무작위로 선택하여 데이터 세트를 만듭니다. 그런 다음 이 데이터 세트를 6:2:2 비율로 훈련, 검증 및 테스트 세트로 분할합니다.

creating-uav-image-dataset-for-estimation-invasive-plant

Research

JoVE Journal

Engineering

Creating a UAV Image Dataset for the Estimation of Invasive Plant Biomass

165 조회수. 시작하려면 연구 지역의 토양 샘플링 위치를 결정하기 위해 충분한 바이오매스 샘플로 무작위 샘플링 접근 방식을 사용합니다. 샘플 프레임을 식물 위에 수평으로 배치하여 각 식물 사이에 최소 2미터의 이격 거리로 식물을 완전히 둘러쌉니다. 드론과 카메라를 사용하여 무인 항공기 또는 UAV 원격 감지 촬영 시스템을 구축합니다.UAV를 사용하여 지정된 연구 영역 내에서...

비디오: 침입 식물 바이오매스 추정을 위한 UAV 이미지 데이터 세트 생성

Computer Vision-Based Biomass Estimation for Invasive Plants

We report on the detailed steps of a method to estimate the biomass of invasive plants based on UAV remote sensing and computer vision. To collect samples from the study area, we prepared a sample square assembly to randomize the sampling points. An unmanned aerial camera system was constructed using a drone and camera to acquire continuous RGB images of the study area through automated navigation. After completing the shooting, the aboveground biomass in the sample frame was collected, and all correspondences were labeled and packaged. The sample data was processed, and the aerial images were segmented into small images of 280 x 280 pixels to create an image dataset. A deep convolutional neural network was used to map the distribution of Mikania micrantha in the study area, and its vegetation index was obtained. The organisms collected were dried, and the dry weight was recorded as the ground truth biomass. The invasive plant biomass regression model was constructed using the K-nearest neighbor regression (KNNR)&#160;by extracting the vegetation index from the sample images as an independent variable and integrating it with the ground truth biomass as a dependent variable. The results showed that it was possible to predict the biomass of invasive plants accurately. An accurate spatial distribution map of invasive plant biomass was generated by image traversal, allowing precise identification of high-risk areas affected by invasive plants. In summary, this study demonstrates the potential of combining unmanned aerial vehicle remote sensing with&#160;machine learning techniques to estimate invasive plant biomass. It contributes significantly to the research of new technologies and methods for real-time monitoring of invasive plants and provides technical support for intelligent monitoring and hazard assessment at the regional scale.

We report detailed procedures for an invasive plant biomass estimation method that utilizes data obtained from unmanned aerial vehicle (UAV) remote sensing to assess biomass and capture the spatial distribution of invasive species. This approach proves highly beneficial for conducting hazard assessment and early warning of invasive plants.

We report on the detailed steps of a method to estimate the biomass of invasive plants based on UAV remote sensing and computer vision. To collect samples ...

연구

공학

To begin, employ a random sampling approach with enough biomass samples to determine soil sampling locations in the study area. Position the sample frame horizontally over the vegetation, fully encompassing the plants with a minimum separation distance of two meters between each plant. Use a drone and a camera to build an unmanned aerial vehicle or UAV remote sensing filming system.To plot the route within the specified study area using the UAV, first, establish a heading and side overlap rate of 70%Maintain the camera perpendicular to the ground, and at an altitude of 30 meters to capture photos at uniform time intervals of two seconds. Run the script file to store the aerial imagery for subsequent processing with Python software for biomass estimation. For creating the dataset using Python programming, proceed to segment the raw image data into smaller images of size the same as the sample images.Use the sliding window method for segmentation, setting the horizontal and vertical steps to 280 pixels. From the segmented small images, randomly select 880 invasive plant images and 1, 500 background images to create a dataset. Then split this dataset into training, validation, and test sets in a 6:2:2 ratio.

Collecting the Aboveground Biomass of Mikania micrantha Samples After UAV Data Collection

To begin, collect the above ground biomass of chamomile manually within each sample plot after completion of drone data collection. While collecting, cut the chamomile along the inside edge of the sample plot. Then, cut the rhizome of the chamomile from the bottom.Remove any dirt, rocks, or other plants that are mixed in. Finally, bag and label the samples. Next, bring the collected samples of invasive plants to the laboratory.Air dry all samples to evaporate most of the moisture. Dry the samples in an oven at 55 degrees Celsius for 72 hours to remove any residual moisture. Place a bag of chamomile on an electronic balance and record the stabilized readings in grams.Once done, calibrate again and continue weighing. Weigh the chamomile every hour until the mass no longer changes. Subtract the weight of the bag from the reading to obtain the measured mass of that sample.Finally, calculate the above ground biomass of the invasive plant using the formula displayed.

UAV 데이터 수집 후 Mikania micrantha 샘플의 지상 바이오매스 수집

Identification and Biomass Estimation of Mikania micrantha Using Data Obtained from an Unmanned Aerial Vehicle (UAV)

To prepare the software, download and install Anaconda from its official website. Launch the PyCharm IDE program. Then open the Anaconda prompt command line and type conda create n pytorch python=3.8 to create a new Conda environment.After the environment is created, enter conda info envs to confirm that the PyTorch environment exists. Open the Anaconda prompt and activate the PyTorch environment by entering conda activate pytorch. type nvidia-smi to check the current compute unified device architecture, or CUDA, version, then install PyTorch version 1.8.1 by running the command conda install pytorch=1.8.1 torchvision=0.9.1 torchaudio=0.8.1 cudatoolkit=11.0 c pytorch.To run the model recognition, pre-process the images to prepare them for model input. Using the displayed code, resize the images from 280 by 280 pixels to 224 by 224 pixels, and normalize them to ensure they meet the model size requirements. Train a multi-class recognition model with the already created dataset by setting the number of iterations to 200 and an initial learning rate of 0.0001.Reduce the learning rate by a third every 10 iterations with a batch size of 64. Save the optimal model parameters automatically after each iteration. Right-click and press run script.Then employ a meticulously trained recognition model and systematically traverse the original image for identification purposes. Configure horizontal and vertical steps precisely at 280 pixels to result in the generation of a comprehensive distribution map, highlighting the presence of invasive flora within the boundaries of the study area. Present the selected results visually.Perform simple data augmentation with a random resized crop and random horizontal flip functions. To extend the image set and extract the six vegetation indices. To ensure precise estimation of the biomass of invasive plants, create a K-nearest neighbor regression model using the output and the extracted vegetation indices as inputs Mikania micrantha could be observed climbing atop the plant adorned with white flowers, the other plants, as well as the road, and accompanying elements were uniformly depicted in the background.The model recognized the red part as Mikania micrantha, demonstrating robust detection in complex backgrounds. The regression analysis demonstrated strong predictive performance with an R squared value of 0.62 and an RMSE of 10.56 grams per square meter. The model enhanced the accuracy of chamomile biomass estimation, and the spatial distribution map effectively captured the distribution of chamomile biomass.