Algorithmic Implementation and Evaluation for Image Segmentation Techniques

Umer Ijaz; Fouzia Gillani; Muhammad Saad Sharif; Ali Iqbal; Muhammad Fraz Anwar; Abubaker Ijaz

Authors

Umer Ijaz Department of Electrical Engineering & Technology, GC University, Faisalabad https://orcid.org/0000-0002-5405-6750
Fouzia Gillani Department of Mechanical Engineering and Technology, GC University, Faisalabad
Muhammad Saad Sharif Department of Electrical Engineering & Technology, GC University, Faisalabad
Ali Iqbal Department of Electrical Engineering & Technology, GC University, Faisalabad
Muhammad Fraz Anwar Department of Electrical Engineering & Technology, GC University, Faisalabad
Abubaker Ijaz WASA, Faisalabad

Keywords:

Image Segmentation, Comparative Analysis, Algorithm Evaluation, Jaccard Index, Dice Coefficient, Pixel Accuracy, Mean Intersection over Union, Image Processing, Computational Metrics

Abstract

This research conducts a comprehensive comparative analysis of five prominent image segmentation algorithms, including Thresholding, K-Means Clustering, Mean Shift, Graph-Based Segmentation (Watershed), and U-Net (Deep Learning). The study employs a diverse set of five images and associated masks to rigorously evaluate algorithmic performance using key metrics such as Jaccard Index, Dice Coefficient, Pixel Accuracy, Hausdorff Distance, and Mean Intersection over Union. The findings reveal that the Threshold Algorithm consistently outperformed its counterparts, achieving perfect scores in Jaccard Index, Dice Coefficient, Pixel Accuracy, and Mean Intersection over Union, while minimizing Hausdorff Distance to 0. This emphasized its exceptional accuracy, precision, and agreement with ground truth segmentation, positioning it as an optimal choice for applications demanding precise segmentation, such as medical imaging or object detection. The research underscores the need to carefully consider specific application requirements and tradeoffs when selecting an algorithm, offering valuable guidance to researchers and practitioners in the field of image segmentation. The standardized approach outlined in the material and methods section ensures fair comparisons, making this study a valuable resource for informed decision-making in diverse imaging applications.

Author Biographies

Umer Ijaz, Department of Electrical Engineering & Technology, GC University, Faisalabad

Assistant Professor

Department of Electrical Engineering & Technology, GC University, Faisalabad

Fouzia Gillani, Department of Mechanical Engineering and Technology, GC University, Faisalabad

Assistant Professor

Department of Mechanical Engineering and Technology, GC University, Faisalabad

Muhammad Saad Sharif, Department of Electrical Engineering & Technology, GC University, Faisalabad

Lecturer

Department of Electrical Engineering & Technology, GC University, Faisalabad

Ali Iqbal, Department of Electrical Engineering & Technology, GC University, Faisalabad

Lecturer

Department of Electrical Engineering & Technology, GC University, Faisalabad

Muhammad Fraz Anwar, Department of Electrical Engineering & Technology, GC University, Faisalabad

Teaching Assistant

Department of Electrical Engineering & Technology, GC University, Faisalabad

Abubaker Ijaz, WASA, Faisalabad

Director Development

WASA, Faisalabad

References

Z. Wang, E. Wang, and Y. Zhu, “Image segmentation evaluation: a survey of methods,” Artif. Intell. Rev., vol. 53, no. 8, pp. 5637–5674, Dec. 2020, doi: 10.1007/S10462-020-09830-9/METRICS.

P. Jaglan, R. Dass, and M. Duhan, “A Comparative Analysis of Various Image Segmentation Techniques,” Lect. Notes Networks Syst., vol. 46, pp. 359–374, 2019, doi: 10.1007/978-981-13-1217-5_36/COVER.

“A survey on segmentation techniques for image processing.” Accessed: Feb. 26, 2024. [Online]. Available: https://ijeee.edu.iq/Papers/Vol17-Issue2/1570736047.pdf

S. Singh, N. Mittal, D. Thakur, H. Singh, D. Oliva, and A. Demin, “Nature and Biologically Inspired Image Segmentation Techniques,” Arch. Comput. Methods Eng. 2021 293, vol. 29, no. 3, pp. 1415–1442, Jun. 2021, doi: 10.1007/S11831-021-09619-1.

S. Song and T. Gao, “Research on image segmentation algorithm based on threshold,” Proc. - 2021 13th Int. Conf. Meas. Technol. Mechatronics Autom. ICMTMA 2021, pp. 306–308, Jan. 2021, doi: 10.1109/ICMTMA52658.2021.00071.

K. K. D. Ramesh, G. Kiran Kumar, K. Swapna, D. Datta, and S. Suman Rajest, “A Review of Medical Image Segmentation Algorithms,” EAI Endorsed Trans. Pervasive Heal. Technol., vol. “7,” no. 27, Apr. 2021, doi: 10.4108/EAI.12-4-2021.169184.

S. Pare, A. Kumar, G. K. Singh, and V. Bajaj, “Image Segmentation Using Multilevel Thresholding: A Research Review,” Iran. J. Sci. Technol. - Trans. Electr. Eng., vol. 44, no. 1, pp. 1–29, Mar. 2020, doi: 10.1007/S40998-019-00251-1/METRICS.

M. Abdel-Basset, V. Chang, and R. Mohamed, “A novel equilibrium optimization algorithm for multi-thresholding image segmentation problems,” Neural Comput. Appl., vol. 33, no. 17, pp. 10685–10718, Sep. 2021, doi: 10.1007/S00521-020-04820-Y/METRICS.

C. Shi, Y. Zhou, B. Qiu, D. Guo, and M. Li, “CloudU-Net: A Deep Convolutional Neural Network Architecture for Daytime and Nighttime Cloud Images’ Segmentation,” IEEE Geosci. Remote Sens. Lett., vol. 18, no. 10, pp. 1688–1692, Oct. 2021, doi: 10.1109/LGRS.2020.3009227.

H. S. Lee et al., “Efficient Defect Identification via Oxide Memristive Crossbar Array Based Morphological Image Processing,” Adv. Intell. Syst., vol. 3, no. 2, p. 2000202, Feb. 2021, doi: 10.1002/AISY.202000202.

M. Ahmed, R. Seraj, and S. M. S. Islam, “The k-means Algorithm: A Comprehensive Survey and Performance Evaluation,” Electron. 2020, Vol. 9, Page 1295, vol. 9, no. 8, p. 1295, Aug. 2020, doi: 10.3390/ELECTRONICS9081295.

K. Tian, J. Li, J. Zeng, A. Evans, and L. Zhang, “Segmentation of tomato leaf images based on adaptive clustering number of K-means algorithm,” Comput. Electron. Agric., vol. 165, p. 104962, Oct. 2019, doi: 10.1016/J.COMPAG.2019.104962.

A. M. Ikotun, A. E. Ezugwu, L. Abualigah, B. Abuhaija, and J. Heming, “K-means clustering algorithms: A comprehensive review, variants analysis, and advances in the era of big data,” Inf. Sci. (Ny)., vol. 622, pp. 178–210, Apr. 2023, doi: 10.1016/J.INS.2022.11.139.

T. G. Debelee, F. Schwenker, S. Rahimeto, and D. Yohannes, “Evaluation of modified adaptive k-means segmentation algorithm,” Comput. Vis. Media, vol. 5, no. 4, pp. 347–361, Dec. 2019, doi: 10.1007/S41095-019-0151-2/METRICS.

M. S. Yang and K. P. Sinaga, “A feature-reduction multi-view k-means clustering algorithm,” IEEE Access, vol. 7, pp. 114472–114486, 2019, doi: 10.1109/ACCESS.2019.2934179.

M. Zhao et al., “Faster Mean-shift: GPU-accelerated clustering for cosine embedding-based cell segmentation and tracking,” Med. Image Anal., vol. 71, p. 102048, Jul. 2021, doi: 10.1016/J.MEDIA.2021.102048.

S. Yun and S. Kim, “Robust infrared target tracking using thermal information in mean-shift,” https://doi.org/10.1117/12.2519191, vol. 10995, pp. 52–57, May 2019, doi: 10.1117/12.2519191.

J. W. Hsieh, C. H. Chou, M. C. Chang, P. Y. Chen, S. Santra, and C. S. Huang, “Mean-Shift Based Differentiable Architecture Search,” IEEE Trans. Artif. Intell., 2023, doi: 10.1109/TAI.2023.3329792.

J. J. Hwang et al., “SegSort: Segmentation by discriminative sorting of segments,” Proc. IEEE Int. Conf. Comput. Vis., vol. 2019-October, pp. 7333–7343, Oct. 2019, doi: 10.1109/ICCV.2019.00743.

Q. Huang, Y. Huang, Y. Luo, F. Yuan, and X. Li, “Segmentation of breast ultrasound image with semantic classification of superpixels,” Med. Image Anal., vol. 61, p. 101657, Apr. 2020, doi: 10.1016/J.MEDIA.2020.101657.

X. Jia, T. Lei, P. Liu, D. Xue, H. Meng, and A. K. Nandi, “Fast and Automatic Image Segmentation Using Superpixel-Based Graph Clustering,” IEEE Access, 2020, doi: 10.1109/ACCESS.2020.3039742.

A. Ibrahim, “Image Segmentation Methods Based on Superpixel Techniques: A Survey.” Jan. 01, 2020. Accessed: Feb. 26, 2024. [Online]. Available: https://www.academia.edu/70227250/Image_Segmentation_Methods_Based_on_Superpixel_Techniques_A_Survey

Y. Mourchid, M. El Hassouni, and H. Cherifi, “A general framework for complex network-based image segmentation,” Multimed. Tools Appl., vol. 78, no. 14, pp. 20191–20216, Jul. 2019, doi: 10.1007/S11042-019-7304-2/METRICS.

Y. Zhou, G. Gallego, X. Lu, S. Liu, and S. Shen, “Event-Based Motion Segmentation with Spatio-Temporal Graph Cuts,” IEEE Trans. Neural Networks Learn. Syst., vol. 34, no. 8, pp. 4868–4880, Aug. 2023, doi: 10.1109/TNNLS.2021.3124580.

Y. Zhao et al., “Graph-based region and boundary aggregation for biomedical image segmentation,” IEEE Trans. Med. Imaging, vol. 41, no. 3, pp. 690–701, Mar. 2022, doi: 10.1109/TMI.2021.3123567.

S. Momin, Y. Lei, and Z. Tian, “Medical Image Segmentation Based on U-Net,” J. Phys. Conf. Ser., vol. 2547, no. 1, p. 012010, Jul. 2023, doi: 10.1088/1742-6596/2547/1/012010.

N. Siddique, S. Paheding, C. P. Elkin, and V. Devabhaktuni, “U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications,” IEEE Access, vol. 9, pp. 82031–82057, 2021, doi: 10.1109/ACCESS.2021.3086020.

V. D. Nahian Siddique, Paheding Sidike, Colin Elkin, “U-Net and its variants for medical image segmentation: theory and applications”, [Online]. Available: https://arxiv.org/abs/2011.01118

L. Yin et al., “U-Net-STN: A Novel End-to-End Lake Boundary Prediction Model,” L. 2023, Vol. 12, Page 1602, vol. 12, no. 8, p. 1602, Aug. 2023, doi: 10.3390/LAND12081602.

R. Azad, M. Asadi-Aghbolaghi, M. Fathy, and S. Escalera, “Bi-directional ConvLSTM U-net with densley connected convolutions,” Proc. - 2019 Int. Conf. Comput. Vis. Work. ICCVW 2019, pp. 406–415, Oct. 2019, doi: 10.1109/ICCVW.2019.00052.

“SIPI Image Database - Misc.” Accessed: Dec. 02, 2023. [Online]. Available: https://sipi.usc.edu/database/database.php?volume=misc

T. Eelbode et al., “Optimization for Medical Image Segmentation: Theory and Practice When Evaluating With Dice Score or Jaccard Index,” IEEE Trans. Med. Imaging, vol. 39, no. 11, pp. 3679–3690, Nov. 2020, doi: 10.1109/TMI.2020.3002417.

J. Bertels et al., “Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory and Practice,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 11765 LNCS, pp. 92–100, 2019, doi: 10.1007/978-3-030-32245-8_11/COVER.

N. A. Muhadi, A. F. Abdullah, S. K. Bejo, M. R. Mahadi, and A. Mijic, “Image Segmentation Methods for Flood Monitoring System,” Water 2020, Vol. 12, Page 1825, vol. 12, no. 6, p. 1825, Jun. 2020, doi: 10.3390/W12061825.

R. R. Shamir, Y. Duchin, J. Kim, G. Sapiro, and N. Harel, “Continuous Dice Coefficient: a Method for Evaluating Probabilistic Segmentations,” bioRxiv, p. 306977, Apr. 2018, doi: 10.1101/306977.

R. Zhao et al., “Rethinking dice loss for medical image segmentation,” Proc. - IEEE Int. Conf. Data Mining, ICDM, vol. 2020-November, pp. 851–860, Nov. 2020, doi: 10.1109/ICDM50108.2020.00094.

B. Cheng, R. Girshick, P. Dollár, A. C. Berg, and A. Kirillov, “Boundary IoU: Improving object-centric image segmentation evaluation,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 15329–15337, 2021, doi: 10.1109/CVPR46437.2021.01508.

É. O. Rodrigues, “An efficient and locality-oriented Hausdorff distance algorithm: Proposal and analysis of paradigms and implementations,” Pattern Recognit., vol. 117, p. 107989, Sep. 2021, doi: 10.1016/J.PATCOG.2021.107989.

J. T. Jeng, C. M. Chen, S. C. Chang, and C. C. Chuang, “IPFCM Clustering Algorithm Under Euclidean and Hausdorff Distance Measure for Symbolic Interval Data,” Int. J. Fuzzy Syst., vol. 21, no. 7, pp. 2102–2119, Oct. 2019, doi: 10.1007/S40815-019-00707-W/METRICS.

Y.-J. Cho, “Weighted Intersection over Union (wIoU): A New Evaluation Metric for Image Segmentation,” Jul. 2021, Accessed: Feb. 26, 2024. [Online]. Available: https://arxiv.org/abs/2107.09858v4

H. Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, and S. Savarese, “Generalized intersection over union: A metric and a loss for bounding box regression,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2019-June, pp. 658–666, Jun. 2019, doi: 10.1109/CVPR.2019.00075.