BeetleFlow: An Integrative Deep Learning Pipeline for Beetle Image Processing

Authors:Fangxun Liu, S M Rayeed, Samuel Stevens, Alyson East, Cheng Hsuan Chiang, Colin Lee, Daniel Yi, Junke Yang, Tejas Naik, Ziyi Wang, Connor Kilrain, Elijah H Buckwalter, Jiacheng Hou, Saul Ibaven Bueno, Shuheng Wang, Xinyue Ma, Yifan Liu, Zhiyuan Tao, Ziheng Zhang, Eric Sokol, Michael Belitz, Sydne Record, Charles V. Stewart, Wei-Lun Chao

View PDF HTML (experimental)

Abstract:In entomology and ecology research, biologists often need to collect a large number of insects, among which beetles are the most common species. A common practice for biologists to organize beetles is to place them on trays and take a picture of each tray. Given the images of thousands of such trays, it is important to have an automated pipeline to process the large-scale data for further research. Therefore, we develop a 3-stage pipeline to detect all the beetles on each tray, sort and crop the image of each beetle, and do morphological segmentation on the cropped beetles. For detection, we design an iterative process utilizing a transformer-based open-vocabulary object detector and a vision-language model. For segmentation, we manually labeled 670 beetle images and fine-tuned two variants of a transformer-based segmentation model to achieve fine-grained segmentation of beetles with relatively high accuracy. The pipeline integrates multiple deep learning methods and is specialized for beetle image processing, which can greatly improve the efficiency to process large-scale beetle data and accelerate biological research.

Comments: 4 pages, NeurIPS 2025 Workshop Imageomics

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2511.00255 [cs.CV]

(or arXiv:2511.00255v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2511.00255

arXiv-issued DOI via DataCite

Submission history

From: Fangxun Liu [view email] [v1] Fri, 31 Oct 2025 20:55:33 UTC (13,803 KB) [v2] Fri, 27 Mar 2026 15:02:34 UTC (13,802 KB)