Analysis of Architecture Combining Convolutional Neural Network (CNN) and Kernel K-Means Clustering for Lung Cancer Diagnosis

Zuherman Rustam, Sri Hartini, Rivan Y. Pratama, Reyhan E. Yunus, Rahmat Hidayat

Abstract


In this paper, we proposed the modified deep learning method that combined Convolutional Neural Network (CNN) and Kernel K-Means clustering for lung cancer diagnosis. The Anti-PD-1 Immunotherapy Lung dataset obtained from The Cancer Imaging Archive was used to evaluate our proposed method. From this dataset, we use 400 Magnetic Resonance Imaging (MRI) images that manually labeled consists of 150 healthy lung images and 250 lung cancer images. As the first step, all the data was examined through the CNN architecture. The flatten neuron of the feature map for every image resulted from the convolutional layers in CNN is gained and passed through the kernel k-means clustering algorithm. This algorithm then used to obtain the centroid of each cluster that determines the prediction class of every data point in the validation set. The performance of our proposed method was evaluated using several k values in k-fold cross-validation. According to our experiments, our proposed method achieved the highest performance measure with 98.85 percent accuracy, 98.32 percent sensitivity, 99.40 percent precision, 99.39 percent specificity, and 98.86 percent F1-Score when using RBF kernel function with sigma=0.05 in 9-fold cross-validation. Those performance improves 1.31% sensitivity, 1.12% accuracy, 1.11% F1-Score, 0.92% specificity, and 0.91% precision compared to when using 5-fold cross-validation. It is even obtained in less than 8 seconds for passing the dataset to the CNN model and 40 ± 0.77 seconds for examined in kernel k-means clustering. Therefore, it was proved that our proposed method has an efficient and promised performance for lung cancer diagnosis from MRI images.

Keywords


artificial intelligence; artificial neural network; deep learning; image classification; kernel function; k-means clustering; lung cancer diagnosis.

Full Text:

PDF

References


F. Jiang et al., "Artificial intelligence in healthcare: past, present and future," Stroke and Vascular Neurology, vol. 2, no. 4, p. 230, 2017, doi: 10.1136/svn-2017-000101.

M. Bakator and D. Radosav, "Deep Learning and Medical Diagnosis: A Review of Literature," Multimodal Technologies Interact, vol. 2(3), no. 47, 2018, doi: 10.3390/mti2030047.

G. González et al., "Disease Staging and Prognosis in Smokers Using Deep Learning in Chest Computed Tomography," (in eng), Am J Respir Crit Care Med, vol. 197, no. 2, pp. 193-203, Jan 15 2018, doi: 10.1164/rccm.201705-0860OC.

W. Sun, B. Zheng, and W. Qian, Computer aided lung cancer diagnosis with deep learning algorithms (SPIE Medical Imaging). SPIE, 2016.

R. Anirudh, J. Thiagarajan, T. Bremer, and H. Kim, Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data (SPIE Medical Imaging). SPIE, 2016.

J. L. Causey et al., "Highly accurate model for prediction of lung nodule malignancy with CT scans," Scientific Reports, vol. 8, no. 1, p. 9286, 2018/06/18 2018, doi: 10.1038/s41598-018-27569-w.

A. Chon and N. Balachandar, "Deep Convolutional Neural Networks for Lung Cancer Detection," Conference Proceedings 2017.

M. Winkels and T. S. Cohen, "3D G-CNNs for Pulmonary Nodule Detection," arXiv e-prints, p. arXiv:1804.04656. [Online]. Available: https://ui.adsabs.harvard.edu/abs/2018arXiv180404656W

R. Zhang, C. Cheng, X. Zhao, and X. Li, "Multiscale Mask R-CNN-Based Lung Tumor Detection Using PET Imaging," (in eng), Mol Imaging, vol. 18, p. 1536012119863531, Jan-Dec 2019, doi: 10.1177/1536012119863531.

J. Leng, T. Li, G. Bai, Q. Dong, and H. Dong, "Cube-CNN-SVM: A Novel Hyperspectral Image Classification Method," in 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI), 6-8 Nov. 2016 2016, pp. 1027-1034, doi: 10.1109/ICTAI.2016.0158.

X. X. Niu and C. Y. Suen, "A novel hybrid CNN–SVM classifier for recognizing handwritten digits," Pattern Recognition, vol. 45, no. 4, pp. 1318-1325, 2012/04/01/ 2012, doi: 10.1016/j.patcog.2011.09.021.

M. Elleuch, R. Maalej, and M. Kherallah, "A New Design Based-SVM of the CNN Classifier Architecture with Dropout for Offline Arabic Handwritten Recognition," Procedia Computer Science, vol. 80, pp. 1712-1723, 2016/01/01/ 2016, doi: 10.1016/j.procs.2016.05.512.

U. Aprilliani and Z. Rustam, "Osteoarthritis Disease Prediction Based on Random Forest," in 2018 International Conference on Advanced Computer Science and Information Systems (ICACSIS), 27-28 Oct. 2018 2018, pp. 237-240, doi: 10.1109/ICACSIS.2018.8618166.

M. Huljanah, Z. Rustam, S. Utama, and T. Siswantining, "Feature Selection using Random Forest Classifier for Predicting Prostate Cancer," IOP Conference Series: Materials Science and Engineering, vol. 546, p. 052031, 2019/06/26 2019, doi: 10.1088/1757-899x/546/5/052031.

Z. Rustam and N. P. A. Audia Ariantari, "Support Vector Machines for Classifying Policyholders Satisfactorily in Automobile Insurance," Journal of Physics: Conference Series, vol. 1028, p. 012005, 2018/06 2018, doi: 10.1088/1742-6596/1028/1/012005.

T. V. Rampisela and Z. Rustam, "Classification of Schizophrenia Data Using Support Vector Machine (SVM)," Journal of Physics: Conference Series, vol. 1108, p. 012044, 2018/11 2018, doi: 10.1088/1742-6596/1108/1/012044.

T. Nadira and Z. Rustam, "Classification of cancer data using support vector machines with features selection method based on global artificial bee colony," AIP Conference Proceedings, vol. 2023, no. 1, p. 020205, 2018, doi: 10.1063/1.5064202.

Z. Rustam and R. Faradina, "Face Recognition to Identify Look-Alike Faces using Support Vector Machine," Journal of Physics: Conference Series, vol. 1108, p. 012071, 2018/11 2018, doi: 10.1088/1742-6596/1108/1/012071.

Arfiani, Z. Rustam, J. Pandelaki, and A. Siahaan, "Kernel Spherical K-Means and Support Vector Machine for Acute Sinusitis Classification," IOP Conference Series: Materials Science and Engineering, vol. 546, p. 052011, 2019/06/26 2019, doi: 10.1088/1757-899x/546/5/052011.

Z. Rustam and A. S. Talita, "Fuzzy Kernel k-Medoids algorithm for anomaly detection problems," AIP Conference Proceedings, vol. 1862, no. 1, p. 030154, 2017, doi: 10.1063/1.4991258.

J. Guérin and B. Boots, "Improving Image Clustering With Multiple Pretrained CNN Feature Extractors," arXiv e-prints, p. arXiv:1807.07760. [Online]. Available: https://ui.adsabs.harvard.edu/abs/2018arXiv180707760G

P. Madhavi, S. Patel, and A. S. Tsao, "Data from Anti-PD-1 Immunotherapy Lung [Data set]," The Cancer Imaging Archive, 2019, doi: 10.7937/tcia.2019.zjjwb9ip.

A. F. Agarap, "An Architecture Combining Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for Image Classification," arXiv e-prints, p. arXiv:1712.03541, 2017. [Online]. Available: https://ui.adsabs.harvard.edu/abs/2017arXiv171203541A.

T. Gorach, "Deep Convolutional Neural Networks- A Review," International Research Journal of Engineering and Technology, vol. 5, no. 7, 2018.

M. Egmont-Petersen, D. de Ridder, and H. Handels, "Image processing with neural networks—a review," Pattern Recognition, vol. 35, no. 10, pp. 2279-2301, 2002/10/01/ 2002, doi: 10.1016/S0031-3203(01)00178-9.

Z. Rustam, R. Yuda, H. Alatas, and C. Aroef, "Pulmonary rontgen classification to detect pneumonia disease using convolutional neural networks," TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 18, p. 1522, 06/01 2020, doi: 10.12928/telkomnika. v18i3.14839.

A. Khan, A. Sohail, U. Zahoora, and A. Saeed Qureshi, "A Survey of the Recent Architectures of Deep Convolutional Neural Networks," arXiv e-prints, p. arXiv:1901.06032. [Online]. Available: https://ui.adsabs.harvard.edu/abs/2019arXiv190106032K

C. Nwankpa, W. Ijomah, A. Gachagan, and S. Marshall, "Activation Functions: Comparison of trends in Practice and Research for Deep Learning," arXiv e-prints, p. arXiv:1811.03378. [Online]. Available: https://ui.adsabs.harvard.edu/abs/2018arXiv181103378N

G. Lin and W. Shen, "Research on convolutional neural network based on improved Relu piecewise activation function," Procedia Computer Science, vol. 131, pp. 977-984, 2018/01/01/ 2018, doi: 10.1016/j.procs.2018.04.239.

J. Gu et al., "Recent advances in convolutional neural networks," Pattern Recognition, vol. 77, pp. 354-377, 2018/05/01/ 2018, doi: 10.1016/j.patcog.2017.10.013.

F. Schilling, "The effect of batch normalization on deep convolutional neural networks," Degree Project in Computer Science and Engineering, School of Computer Science and Communication, KTH Royal Institute of Technology, Stockholm, Sweden, 2016.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929–1958, 2014.

R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, "Convolutional neural networks: an overview and application in radiology," Insights into Imaging, vol. 9, no. 4, pp. 611-629, 2018/08/01 2018, doi: 10.1007/s13244-018-0639-9.

M. Welling, "Kernel k-means and spectral clustering," 2013.

S. Lloyd, "Least squares quantization in PCM," IEEE Transactions on Information Theory, vol. 28, no. 2, pp. 129-137, 1982, doi: 10.1109/TIT.1982.1056489.

C. M. Bishop, Pattern recognition and machine learning. New York: Springer, 2006.

V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.

L. Liu, B. Shen, and X. Wang, "Research on Kernel Function of Support Vector Machine," in Advanced Technologies, Embedded and Multimedia for Human-centric Computing. Lecture Notes in Electrical Engineering, vol. 260, Y. M. Huang, H. C. Chao, D. J. Deng, and J. Park Eds.: Springer, Dordrecht, 2013.

Q. Yin, R. Zhang, and X. Shao, "CNN and RNN mixed model for image classification," MATEC Web Conf., vol. 277, p. 02001, 2019, doi: 10.1051/matecconf/201927702001.

Aditi, M. Nagda, and P. Eswaran, "Image Classification using a Hybrid LSTM-CNN Deep Neural Network," vol. 8, 10/19 2019, doi: 10.35940/ijeat.F8602.088619.

B. Sugg, "Convolutional support vector machines for image classification," Master of Science, Departement of Computer Science, University of Exeter, Exeter, England, 2018.

M. Copur, B. M. Ozyildirim, and T. Ibrikci, "Image Classification of Aerial Images Using CNN-SVM," in 2018 Innovations in Intelligent Systems and Applications Conference (ASYU), 4-6 Oct. 2018 2018, pp. 1-6, doi: 10.1109/ASYU.2018.8554008.

K. M. Ting, "Confusion Matrix," in Encyclopedia of Machine Learning and Data Mining, C. Sammut and G. I. Webb Eds. Boston, MA: Springer US, 2017, pp. 260-260.

P. Flach, "Performance Evaluation in Machine Learning: The Good, the Bad, the Ugly, and the Way Forward," Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 9808-9814, 07/17 2019, doi: 10.1609/aaai.v33i01.33019808.

V. Kotu and B. Deshpande, Data Science, 2 ed. Cambridge: Morgan Kaufmann, 2019.




DOI: http://dx.doi.org/10.18517/ijaseit.10.3.12113

Refbacks

  • There are currently no refbacks.



Published by INSIGHT - Indonesian Society for Knowledge and Human Development