Image Classification Based on ResNet Models

Authors

  • Yirong Xu

DOI:

https://doi.org/10.61173/c5xnwg67

Keywords:

ResNet18, ResNet50, CIFAR10, Convolutional neural network

Abstract

Convolutional neural networks (CNNs) hold significant importance in the image categorization field. The issue of vanishing gradients with increasing dataset size is effectively addressed by ResNet through its residual blocks. This paper focuses on comparing the outcomes of 2 ResNet models using the CIFAR10 dataset. The 60,000 photos in the CIFAR10 dataset are split equally between 10 classes. Preprocessing steps for the data, including normalization and augmentation, are part of the experiment. The cross-entropy loss function is employed for optimization. Results indicate that ResNet18 outperformed ResNet50. For ResNet18, the training loss decreased from 1.8464 to 0.2006, and accuracy increased from 0.3311 to 0.9286 with a test accuracy of 0.8294. In contrast, for ResNet50, training loss went from 5.3736 to 0.4618, and accuracy rose from 0.0989 to 0.8377 with a test accuracy of 0.7604. One possible reason for this outcome is that ResNet50 might be more prone to overfitting due to many more parameters and the CIFAR10 dataset’s small size. Additionally, different hyperparameter settings and data augmentation fine-tuning might also contribute.

References

[1] Chen L, Li S, Bai Q, et al. Review of image classification algorithms based on convolutional neural networks. Remote Sensing, 2021, 13(22): 4712.

[2] Borawar L, Kaur R. ResNet: Solving vanishing gradient in deep networks//Proceedings of International Conference on Recent Trends in Computing: ICRTC 2022. Singapore: Springer Nature Singapore, 2023: 235-247.

[3] He F, Liu T, Tao D. Why resnet works? residuals generalize. IEEE transactions on neural networks and learning systems, 2020, 31(12): 5349-5362.

[4] Shafiq M, Gu Z. Deep residual learning for image recognition: A survey. Applied Sciences, 2022, 12(18): 8972.

[5] Sarwinda D, Paradisa R H, Bustamam A, et al. Deep learning in image classification using residual network (ResNet) variants for detection of colorectal cancer. Procedia Computer Science, 2021, 179: 423-431.

[6] Ma L, Shuai R, Ran X, et al. Combining DC-GAN with ResNet for blood cell image classification. Medical & biological engineering & computing, 2020, 58: 1251-1264.

[7] Roy S K, Manna S, Song T, et al. Attention-based adaptive spectral–spatial kernel ResNet for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(9): 7831-7843.

[8] Showkat S, Qureshi S. Efficacy of Transfer Learningbased ResNet models in Chest X-ray image classification for detecting COVID-19 Pneumonia. Chemometrics and Intelligent Laboratory Systems, 2022, 224: 104534.

[9] Cheng J, Tian S, Yu L, et al. ResGANet: Residual group attention network for medical image classification and segmentation. Medical Image Analysis, 2022, 76: 102313.

[10] He K, Zhang X, Ren S, et al. Deep residual learning for image recognition//Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 770-778.

[11] Krizhevsky A, Hinton G. Learning multiple layers of features from tiny images. 2009.

Downloads

Published

2024-12-31