Modified AlexNet Convolution Neural Network For Covid-19 Detection Using Chest X-ray Images

Shadman Q. Salih; Hawre Kh. Abdulla; Zanear Sh. Ahmed; Nigar M. Shafiq Surameery; Rasper Dh. Rashid

doi:10.24017/covid.14

Authors

Shadman Q. Salih Database Technology Department, Technical College of Informatics, Sulaimani Polytechnic University, Sulaimani, Iraq
Hawre Kh. Abdulla Database Technology Department, Technical College of Informatics, Sulaimani Polytechnic University, Sulaimani, Iraq
Zanear Sh. Ahmed Information Technology Department, Erbil Technical institute, Erbil Polytechnic University, Erbil, Iraq
Nigar M. Shafiq Surameery Building and Construction Engineering Department, College of Engineering, University of Garmian Kalar, Sulaimani, Iraq
Rasper Dh. Rashid Software Engineering Department, Faculty of Engineering, Koya University, Koya, Erbil, Iraq

Abstract

First outbreak of COVID-19 was in the city of Wuhan in China in Dec.2019 and then it becomes a pandemic disease all around the world. World Health Organization (WHO) confirmed more than 5.5 million cases and 341,155 deaths from the disease till the time of writing this paper. This new worldwide disease forced researchers to make more precise way to diagnose COVID-19. In the last decade, medical imaging techniques show its efficiency in helping radiologists to detect and diagnose the diseases. Deep learning and transfer learning algorithms are good techniques to detect disease from different image source types such as X-Ray and CT scan images. In this work we used a deep learning technique based on Convolution Neural Network (CNN) to detect and diagnose COVID-19 disease using Chest X-ray images. Moreover, the modified AlexNet architecture is proposed in different scenarios were differing from each other in terms of the type of the pooling layers and/or the number of the neurons that have used in the second fully connected layer. The used chest X-ray images are gathered from two COVID-19 X-ray image datasets and one dataset includes large number of normal and pneumonia X-ray images. With the proposed models we obtained the same or even better result than the original AlexNet with having a smaller number of neurons in the second fully connected layer.

Keywords:

COVID-19, Chest X-Ray Images, CNN, AlexNet, Deep Learning.

References

[1] Y. Song, S. Zheng, X. Zhang, X. Zhang, Z. Huang,J. et al., "Deep learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) with CT images," p. 10, 25 February 2020.
[2] W. H. Organization, Health, [Online]. Available: https://www.who.int/dg/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-may-2020. [Accessed 12 May 2020].
[3] "Worldometers," [Online]. Available: https://www.worldometers.info/coronavirus/. [Accessed 27 May 2020].
[4] Q. Li, M. Med, et al, "Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus-Infected Pneumonia," The new england journal of medicine, vol. 382, p. 13, 26-March-2020.
[5] S. Stoecklin, P. Rolland, et al, "First cases of coronavirus disease 2019 (COVID-19) in France: surveillance, investigations and control measures," Euro surveillance, vol. 2000094, January 2020.
[6] "How to Protect Yourself & Others," Centers for Disease Control and Prevention (CDC), [Online]. Available: https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/prevention.html?CDC_AA_refVal=https%3A%2F%2Fwww.cdc.gov%2Fcoronavirus%2F2019-ncov%2Fprepare%2Fprevention.html. [Accessed 13 May 2020].
[7] S. Khobahi, Ch. Agarwal and M. Soltanalian, "CoroNet: A Deep Network Architecture for Semi-Supervised Task-Based Identification of COVID-19 from Chest X-ray Images," medRxiv , 2020.
https://doi.org/10.1101/2020.04.14.20065722
[8] A. Narin, C. Kaya and Z. Pamuk, "Automatic Detection of Coronavirus Disease (COVID-19) Using X-ray Images and Deep Convolutional Neural Networks," eprint arXiv:2003.10849, p. 17, March 2020.
https://doi.org/10.1007/s10044-021-00984-y
[9] X. Xu, X. Jiang, et al., "Deep Learning System to Screen Coronavirus Disease 2019 Pneumonia," arXiv, vol. 2002.09334, p. 29, 2020.
[10] A. Bhandary, G. Prabhu, et al, "Deep-Learning Framework to Detect Lung Abnormality - A study with Chest X-Ray and Lung CT Scan Images," elsevier Pattern Recogn Lett , vol. 129, pp. 271-278, 2020.
https://doi.org/10.1016/j.patrec.2019.11.013
[11] H. S. Maghdid, A. T. Asaad, et al., "Diagnosing COVID-19 Pneumonia from X-Ray and CT Images using Deep Learning and Transfer Learning Algorithms," arxiv, vol. 2004.00038, p. 8, 2020.
https://doi.org/10.1117/12.2588672
[12] M. Loey, F. Smarandache, et al, "Within the Lack of Chest COVID-19 X-ray Dataset: A Novel Detection Model Based on GAN and Deep Transfer Learning," Symmetry, vol. 12, no. 651, p. 19, 2020.
https://doi.org/10.3390/sym12040651
[13] J. Zhang, Y. Xie, et al., "COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection," arXiv, vol. 2003.12338, p. 6, 2020.

[14] K. Hammoudi, H. Benhabiles, et al., "Deep Learning on Chest X-ray Images to Detect and Evaluate Pneumonia Cases at the Era of COVID-19," arXiv, vol. 2004.03399, p. 6, 2020.
https://doi.org/10.1007/s10916-021-01745-4
[15] Y. LeCun, L. D. Jackel, et al, "Learning algorithms for classification: A comparison on handwritten digit recognition," Neural networks: the statistical mechanics perspective, vol. 261, p. 16, 1995.
[16] A. Krizhevsky, I. Sutskever, et al., "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems 25 (NIPS 2012), 2012.
[17] N. Srivastava, G. Hinton, et al., "Dropout: A Simple Way to Prevent Neural Networks from Overfitting," Journal of Machine Learning Research 15, Vols. 1929-1958, p. 30, 2014.
[18] G. E. Dahl, T. N. Sainath, G. E. Hinton, "IMPROVING DEEP NEURAL NETWORKS FOR LVCSR USING RECTIFIED LINEAR UNITS AND DROPOUT," in 2013 IEEE international conference on acoustics, speech and signal processing, 2013.
https://doi.org/10.1109/ICASSP.2013.6639346
[19] S. Hochreiter, "The vanishing gradient problem during learning recurrent neural nets and problem solutions," International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 06, no. 02, pp. 107-116, 1998.
https://doi.org/10.1142/S0218488598000094
[20] V. Nair, G. E. Hinton, "Rectified Linear Units Improve Restricted Boltzmann Machines," in Proceedings of the 27th international conference on machine learning (ICML-10), 2010.
[21] L. Wang, Z. Q. Lin, A. Wong, "COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Images," arXiv, vol. 2003.09871, p. 12, 2020.
https://doi.org/10.1038/s41598-020-76550-z
[22] J. P.Cohen, P. Morrison, L. Dao, "An open database of COVID-19 cases with chest X-ray or CT images.," arXiv, vol. 2003.11597, p. 4, Mar 2020.
[23] D. S.Kermany, M. Goldbaum, W. Cai , et al., "Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning," Cellpress, vol. 172, no. 5, pp. 1122-1131, 2018.
https://doi.org/10.1016/j.cell.2018.02.010
[24] Larxel, "COVID-19 X rays," Kaggle, [Online]. Available: https://www.kaggle.com/andrewmvd/convid19-X-rays. [Accessed 27 May 2020].
[25] M. Farooq, A. Hafeez, "COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs," arXiv:, vol. 2003.14395 , p. 6, 2020.
[26] T. Majeed, R. Rashid, et al., "Covid-19 Detection using CNN Transfer Learning from X-ray Images," medRxiv, vol. 20098954, p. 10, 2020.
[27] J. Wei, "AlexNet: The Architecture that Challenged CNNs," Towards Data Science, 3 Jul 2019. [Online]. Available: https://towardsdatascience.com/alexnet-the-architecture-that-challenged-cnns-e406d5297951. [Accessed 25 May 2020].
[28] L. Liao, Y. Zhao, et al., "Finding the Secret of CNN Parameter Layout under Strict Size Constraint," in Proceedings of the 25th ACM international conference on Multimedia, 2017.
https://doi.org/10.1145/3123266.3123346