NEUROSCAN: Revolutionizing Brain Tumor Detection Using Vision-Transformer

Kamran khan; Najam Aziz; Afaq ahmad; Munib-ur-Rehman; Yasir Saleem Afridi

Authors

Kamran khan Department of Computer Systems Engineering, University of Engineering & Technology, Peshawar, Pakistan
Najam Aziz University of Engineering & Technology, Peshawar, Pakistan
Afaq ahmad University of Engineering & Technology, Peshawar, Pakistan
Munib-ur-Rehman University of Engineering & Technology, Peshawar, Pakistan
Yasir Saleem Afridi University of Engineering & Technology, Peshawar, Pakistan

Keywords:

Brain Tumor Detection, Medical Imaging, Classification, Vision Transformers, ViT , Machine Learning, Deep Learning

Abstract

Brain tumor detection is a pivotal component of neuroimaging, with significant implications for clinical diagnosis and patient care. In this study, we introduce an innovative deep-learning approach that leverages the cutting-edge Vision Transformer model, renowned for its ability to capture complex patterns and dependencies in images. Our dataset, consisting of 3000 images evenly split between tumor and non-tumor classes, serves as the foundation for our methodology. Employing Vision Transformer architecture, we processed high-resolution brain scans through patching and self-attention mechanisms. The model is trained through supervised learning to perform binary classification tasks. Our employed model achieved a high of 98.37% in tumor detection. While interpretability analysis was not explicitly performed, the inherent use of attention mechanisms in the Vision Transformer model suggests a focus on important brain regions and enhances its potential for prioritizing crucial information in brain tumor detection.

References

S. Kumar, R. Dhir, and N. Chaurasia, “Brain Tumor Detection Analysis Using CNN: A Review,” Proc. - Int. Conf. Artif. Intell. Smart Syst. ICAIS 2021, pp. 1061–1067, Mar. 2021, doi: 10.1109/ICAIS50930.2021.9395920.

S. Hossain, A. Chakrabarty, T. R. Gadekallu, M. Alazab, and M. J. Piran, “Vision Transformers, Ensemble Model, and Transfer Learning Leveraging Explainable AI for Brain Tumor Detection and Classification,” IEEE J. Biomed. Heal. Informatics, vol. 28, no. 3, pp. 1261–1272, Mar. 2024, doi: 10.1109/JBHI.2023.3266614.

O. N. Manzari, H. Ahmadabadi, H. Kashiani, S. B. Shokouhi, and A. Ayatollahi, “MedViT: A robust vision transformer for generalized medical image classification,” Comput. Biol. Med., vol. 157, p. 106791, May 2023, doi: 10.1016/J.COMPBIOMED.2023.106791.

M. Puttagunta and S. Ravi, “Medical image analysis based on deep learning approach,” Multimed. Tools Appl. 2021 8016, vol. 80, no. 16, pp. 24365–24398, Apr. 2021, doi: 10.1007/S11042-021-10707-4.

T. Sadad et al., “Brain tumor detection and multi-classification using advanced deep learning techniques,” Microsc. Res. Tech., vol. 84, no. 6, pp. 1296–1308, Jun. 2021, doi: 10.1002/JEMT.23688.

K. Ahn, X. Cheng, M. Song, C. Yun, A. Jadbabaie, and S. Sra, “Linear attention is (maybe) all you need (to understand transformer optimization),” Oct. 2023, Accessed: May 16, 2024. [Online]. Available: https://arxiv.org/abs/2310.01082v2

“Data-Scientist-Books/Data Preparation for Machine Learning Data Cleaning, Feature Selection, and Data Transforms in Python by Jason Brownlee (z-lib.org).pdf at main · aaaastark/Data-Scientist-Books · GitHub.” Accessed: May 16, 2024. [Online]. Available: https://github.com/aaaastark/Data-Scientist-Books/blob/main/Data Preparation for Machine Learning Data Cleaning%2C Feature Selection%2C and Data Transforms in Python by Jason Brownlee (z-lib.org).pdf

A. A. Akinyelu, F. Zaccagna, J. T. Grist, M. Castelli, and L. Rundo, “Brain Tumor Diagnosis Using Machine Learning, Convolutional Neural Networks, Capsule Neural Networks and Vision Transformers, Applied to MRI: A Survey,” J. Imaging 2022, Vol. 8, Page 205, vol. 8, no. 8, p. 205, Jul. 2022, doi: 10.3390/JIMAGING8080205.

W. Wang, C. Chen, M. Ding, H. Yu, S. Zha, and J. Li, “TransBTS: Multimodal Brain Tumor Segmentation Using Transformer,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 12901 LNCS, pp. 109–119, 2021, doi: 10.1007/978-3-030-87193-2_11/COVER.

Y. Jiang, Y. Zhang, X. Lin, J. Dong, T. Cheng, and J. Liang, “SwinBTS: A Method for 3D Multimodal Brain Tumor Segmentation Using Swin Transformer,” Brain Sci. 2022, Vol. 12, Page 797, vol. 12, no. 6, p. 797, Jun. 2022, doi: 10.3390/BRAINSCI12060797.

S. Tummala, S. Kadry, S. A. C. Bukhari, and H. T. Rauf, “Classification of Brain Tumor from Magnetic Resonance Imaging Using Vision Transformers Ensembling,” Curr. Oncol. 2022, Vol. 29, Pages 7498-7511, vol. 29, no. 10, pp. 7498–7511, Oct. 2022, doi: 10.3390/CURRONCOL29100590.

A. A. Asiri et al., “Exploring the Power of Deep Learning: Fine-Tuned Vision Transformer for Accurate and Efficient Brain Tumor Detection in MRI Scans,” Diagnostics 2023, Vol. 13, Page 2094, vol. 13, no. 12, p. 2094, Jun. 2023, doi: 10.3390/DIAGNOSTICS13122094.

E. A. Albadawy, A. Saha, and M. A. Mazurowski, “Deep learning for segmentation of brain tumors: Impact of cross-institutional training and testing,” Med. Phys., vol. 45, no. 3, pp. 1150–1158, Mar. 2018, doi: 10.1002/MP.12752.

R. A. Zeineldin, M. E. Karar, J. Coburger, C. R. Wirtz, and O. Burgert, “DeepSeg: deep neural network framework for automatic brain tumor segmentation using magnetic resonance FLAIR images,” Int. J. Comput. Assist. Radiol. Surg., vol. 15, no. 6, pp. 909–920, Jun. 2020, doi: 10.1007/S11548-020-02186-Z/TABLES/4.

M. I. Sharif, J. P. Li, J. Amin, and A. Sharif, “An improved framework for brain tumor analysis using MRI based on YOLOv2 and convolutional neural network,” Complex Intell. Syst., vol. 7, no. 4, pp. 2023–2036, Aug. 2021, doi: 10.1007/S40747-021-00310-3/TABLES/13.

A. A. Asiri et al., “Block-Wise Neural Network for Brain Tumor Identification in Magnetic Resonance Images,” Comput. Mater. Contin., vol. 73, no. 3, pp. 5735–5753, Jul. 2022, doi: 10.32604/CMC.2022.031747.

A. Dosovitskiy et al., “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale,” ICLR 2021 - 9th Int. Conf. Learn. Represent., Oct. 2020, Accessed: Feb. 21, 2024. [Online]. Available: https://arxiv.org/abs/2010.11929v2.