A SOFTWARE SYSTEM FOR BUILDING GASTROINTESTINAL ENDOSCOPY DATASETS: CLINICAL ANNOTATION SCHEMA AND AUTOMATED QUALITY CONTROL
Main Article Content
Abstract
Abstract. The quality of deep learning models for gastrointestinal endoscopy depends on how the training dataset is assembled, labelled and split no less than on model architecture. In practice, groups combine a general-purpose annotation tool with ad-hoc spreadsheets, which leads to duplicated patients, inconsistent lesion descriptions, leakage of images from one patient between training and test subsets, and annotation noise caused by optical artifacts. We present a desktop workflow that couples a local patient and image registry with the CVAT annotation platform. It (i) keeps identifying data on the local machine and exports only de-identified metadata; (ii) encodes a clinical anatomical and lesion taxonomy as a CVAT label schema; (iii) introduces a single “artifact” class so that models learn to ignore non-diagnostic regions; (iv) imports COCO annotations into relational tables, keeping bounding boxes and polygon masks from one annotation pass; and (v) runs automated quality control, including a patient-leakage check, before export to YOLO (detection and segmentation) and COCO formats. The design is described with IDEF0, IDEF1X and IDEF3 models and compared with existing tools and public datasets.
Article Details
References
Pogorelov K. et al. KVASIR: A multi-class image dataset for computer aided gastrointestinal disease detection // Proc. ACM Multimedia Systems Conference (MMSys), 2017.
Borgli H. et al. HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy // Scientific Data. 2020. Vol. 7. Art. 283.
Jha D. et al. Kvasir-SEG: A segmented polyp dataset // MultiMedia Modeling (MMM 2020), LNCS 11962. 2020. P. 451–462.
Smedsrud P.H. et al. Kvasir-Capsule, a video capsule endoscopy dataset // Scientific Data. 2021. Vol. 8. Art. 142.
Ali S. et al. Endoscopy disease detection challenge 2020 // arXiv:2003.03376. 2020.
Ali S. et al. Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy // Medical Image Analysis. 2021. Vol. 70. Art. 102002.
Ali S. et al. A multi-centre polyp detection and segmentation dataset for generalisability assessment // Scientific Data. 2023. Vol. 10. Art. 75.
Jha D. et al. GastroVision: A multi-class endoscopy image dataset for computer aided gastrointestinal disease detection // ML4MHD workshop, LNCS 14315. 2023.
Oakden-Rayner L. Exploring large-scale public medical image datasets // Academic Radiology. 2020. Vol. 27(1). P. 106–112.
Kapoor S., Narayanan A. Leakage and the reproducibility crisis in machine-learning-based science // Patterns. 2023. Vol. 4(9). Art. 100804.
Russell B.C. et al. LabelMe: A database and web-based tool for image annotation // International Journal of Computer Vision. 2008. Vol. 77.
CVAT.ai Corporation. Computer Vision Annotation Tool (CVAT), software [version, year to be specified].
Labelbox, Inc. Labelbox, software platform. https://labelbox.com.
Redmon J. et al. You Only Look Once: Unified, real-time object detection // CVPR. 2016. [Add the reference for the YOLOv11 release used.]
Ren S. et al. Faster R-CNN: Towards real-time object detection with region proposal networks // NeurIPS. 2015.
Lin T.-Y. et al. Microsoft COCO: Common objects in context // ECCV. 2014.