The rapid development of machine vision has promoted the automation of crop monitoring, providing technical support for planting management.
For this purpose, this paper constructs a visible light-thermal infrared multimodal image dataset for the detection of owers and fruits of facility tomatoes: it includes 300 images of the owering period and 343 images of the fruiting period collected by the H982 visible light camera, as well as 145 images of the fruiting period collected by the HIKMIC thermal infrared camera. The LabelImg tool is used to complete the bounding box annotation of tomato owers, fruits, and fruit maturity. Based on the evaluation of YOLOv11 (n/s/l) and YOLOv13 (n/s/l), the optimal mAP50 for the ower subset can reach 89.86%, while the optimal mAP50 for the fruit subset and the entire dataset is above 84%. The overall detection accuracy is excellent, indicating that the dataset is practical.
The multimodal fusion experiment shows that compared with single visible light, the fusion strategy signicantly improves the detection performance without sacricing the inference eciency almost at all, verifying the complementarity of thermal infrared and visible light, and provi...