Image Covariates and Label Noise Robustness in Dermatoscopic Classification
Downloads
Abstract
Medical image classification depends on labels that can contain diagnostic errors. This study compares six training strategies on DermaMNIST, with 7,007 training images in seven classes and synthetic symmetric, asymmetric, and pixel-difficulty-dependent label noise at nominal rates of 10–40%. The comparison comprises 36 noise-family, rate, and seed combinations, using three seeds and a seven-epoch budget per main network. The instance-dependent-minus-symmetric ERM balanced-accuracy gap changes from +0.063 at 10% to −0.061 at 40%; instance dependence is therefore not uniformly harder for this generator. Image-covariate-only noise scores have pooled AUC 0.502, whereas the combined covariate-and-loss estimator has AUC 0.301 compared with 0.832 for the loss-GMM score. The MIND-CT pipeline has higher reported mean balanced accuracy than its MIND and FC variants, but lower overall means than Co-teaching and ERM: 0.244 versus 0.284 and 0.276. At the designated INST-20% endpoint, Co-teaching reaches 0.343 versus 0.303 for MIND-CT. These findings support a scoped comparison of estimator quality and downstream classification, rather than a conclusion about genuine clinical metadata. Inferential results are exploratory because the grid reuses one archive and three seeds, and source records are needed to reconcile the rank diagram and verify implementation details.
Keywords
Label noise Instance-dependent noise Medical image classification Dermatology Co-teaching Forward correction DermaMNIST Negative resultsReferences (12)
- [1] Wei, Y., Deng, Y., Sun, C., Lin, M., Jiang, H., & Peng, Y. (2024). Deep learning with noisy labels in medical prediction problems: A scoping review. Journal of the American medical informatics association, 31(7), 1596–1607. https://doi.org/10.1093/jamia/ocae108
- [2] Hekler, A., Kather, J. N., Krieghoff-Henning, E., Utikal, J. S., Meier, F., Gellrich, F. F., ... & Brinker, T. J. (2020). Effects of label noise on deep learning-based skin cancer classification. Frontiers in medicine, 7, 177. https://doi.org/10.3389/fmed.2020.00177
- [3] Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., ... & Ng, A. Y. (2019). Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. Proceedings of the AAAI conference on artificial intelligence (Vol. 33, No. 01, pp. 590-597). https://doi.org/10.1609/aaai.v33i01.3301590
- [4] Yang, J., Shi, R., Wei, D., Liu, Z., Zhao, L., Ke, B., ... & Ni, B. (2023). Medmnist v2-a large-scale lightweight benchmark for 2d and 3d biomedical image classification. Scientific data, 10(1), 41. https://doi.org/10.1038/s41597-022-01721-8
- [5] Tschandl, P., Rosendahl, C., & Kittler, H. (2018). The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific data, 5(1), 180161. https://doi.org/10.1038/sdata.2018.161
- [6] Han, B., Yao, Q., Yu, X., Niu, G., Xu, M., Hu, W., … & Sugiyama, M. (2018). Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems, 31. https://doi.org/10.48550/arXiv.1804.06872
- [7] Li, J., Socher, R., & Hoi, S. C. H. (2020). Dividemix: Learning with noisy labels as semi-supervised learning.. https://doi.org/10.48550/arXiv.2002.07394
- [8] Northcutt, C., Jiang, L., & Chuang, I. (2021). Confident learning: Estimating uncertainty in dataset labels. Journal of artificial intelligence research, 70, 1373–1411. https://doi.org/10.1613/jair.1.12125
- [9] Patrini, G., Rozza, A., Krishna Menon, A., Nock, R., & Qu, L. (2017). Making deep neural networks robust to label noise: A loss correction approach. Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1944-1952). IEEE. https://doi.org/10.48550/arXiv.1609.03683
- [10] Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of machine learning research, 7(1), 1–30. https://dl.acm.org/doi/epdf/10.5555/1248547.1248548
- [11] Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics, 6(2), 65–70. https://www.jstor.org/stable/4615733
- [12] International Skin Imaging Collaboration. (2026). ISIC challenge data. https://challenge.isic-archive.com/data/