Detection of on-tree chestnut fruits using deep learning and RGB unmanned aerial vehicle imagery for estimation of yield and fruit load

TY - JOUR

T1 - Detection of on-tree chestnut fruits using deep learning and RGB unmanned aerial vehicle imagery for estimation of yield and fruit load

AU - Arakawa, Takumi

AU - Tanaka, Takashi S.T.

AU - Kamio, Shinji

N1 - Publisher Copyright: © 2023 The Authors. Agronomy Journal © 2023 American Society of Agronomy.

PY - 2024/5

Y1 - 2024/5

N2 - The on-tree counting of chestnut fruit (bur) is essential for yield estimation and monitoring of fruit load as well as tree health, which is important in determining the management strategy for orchards, markets, and tree health monitoring. However, the practice is still conducted by manual count or farmers’ intuition. Precise and effective counting method is yet to be established. This study attempted to count chestnut fruits with the object detection algorithm, You Only Look Once (YOLO), using the RGB imagery collected with an unmanned aerial vehicle (UAV). The model trained with 500 images (7866 burs labeled with bounding boxes) in YOLO version 4 (v4) could count the number of burs with a R2 value of 0.98 and a root mean square error of 6.3 (8.3% of the mean) relative to the manual count in the data set for each whole tree (n = 53). The R2 of linear regression between the number of burs obtained with the YOLOv4 model and the total yield was 0.76, with a standard error of 1.08 kg tree−1 (26.4% of coefficient of variation), which was equivalent to the in situ burs count by an expert technician. In addition, the number of burs counted with the YOLOv4 model after the adjustment of trunk circumference was negatively correlated with nut weight. Overall, the study revealed that YOLO algorithm coupled with UAV-based RGB imagery is a precise and efficient method for on-tree burs detection, which could be used as an indicator of yield and fruit load.

AB - The on-tree counting of chestnut fruit (bur) is essential for yield estimation and monitoring of fruit load as well as tree health, which is important in determining the management strategy for orchards, markets, and tree health monitoring. However, the practice is still conducted by manual count or farmers’ intuition. Precise and effective counting method is yet to be established. This study attempted to count chestnut fruits with the object detection algorithm, You Only Look Once (YOLO), using the RGB imagery collected with an unmanned aerial vehicle (UAV). The model trained with 500 images (7866 burs labeled with bounding boxes) in YOLO version 4 (v4) could count the number of burs with a R2 value of 0.98 and a root mean square error of 6.3 (8.3% of the mean) relative to the manual count in the data set for each whole tree (n = 53). The R2 of linear regression between the number of burs obtained with the YOLOv4 model and the total yield was 0.76, with a standard error of 1.08 kg tree−1 (26.4% of coefficient of variation), which was equivalent to the in situ burs count by an expert technician. In addition, the number of burs counted with the YOLOv4 model after the adjustment of trunk circumference was negatively correlated with nut weight. Overall, the study revealed that YOLO algorithm coupled with UAV-based RGB imagery is a precise and efficient method for on-tree burs detection, which could be used as an indicator of yield and fruit load.

UR - http://www.scopus.com/inward/record.url?scp=85152780339&partnerID=8YFLogxK

U2 - 10.1002/agj2.21330

DO - 10.1002/agj2.21330

M3 - Journal article

AN - SCOPUS:85152780339

SN - 0002-1962

VL - 116

SP - 973

EP - 981

JO - Agronomy Journal

JF - Agronomy Journal

IS - 3

ER -