A Comprehensive Investigation of Attention-Based CNNs for Galaxy Morphology Classification
DOI:
https://doi.org/10.61173/62mfz234Keywords:
Attention CNN, attention-gating, multi-branch attention networks, dynamic multiscale attention networkAbstract
Galaxy morphology classification is a fundamental yet challenging task in astronomical research, as it plays a crucial role in understanding the universe's structure and evolution. The complexity and diversity of galaxy shapes, combined with the large volume of astronomical data, necessitate efficient and accurate automated methods for classification. This paper provides a comprehensive review of attention-based convolutional neural networks (CNNs) for galaxy classification, highlighting their potential to overcome limitations of conventional approaches. This paper systematically surveys three advanced methods: attention-gating, multi-branch attention networks, and dynamic multiscale attention networks, detailing their architectures, mechanisms, and performance gains. These methods enhance feature focus, multi-scale fusion, and interpretability while reducing computational costs. The analysis confirms that attention-based CNNs significantly improve classification accuracy and robustness, making them highly valuable for large-scale astronomical surveys. This review offers valuable insights into current advancements and future directions, contributing to the development of more reliable and efficient galaxy classification systems.
References
[1] Conselice CJ, et al. The Evolution of Galaxy Number Density at z < 8. The Astrophysical Journal. 2016;830(2):83.
[2] Zwicky F, et al. Catalogue of Galaxies and of Clusters of Galaxies (Vol. I-VI). California Institute of Technology, Pasadena; 1961–1968.
[3] Storrie-Lombardi MC, et al. Morphological Classification of Galaxies by Artificial Neural Networks. Monthly Notices of the Royal Astronomical Society. 1992;256(3):427-436.
[4] Dieleman S, et al. Rotation-invariant Convolutional Neural Networks for Galaxy Morphology Prediction. Monthly Notices of the Royal Astronomical Society. 2015;450(2):1441-1459.
[5] Dai J, Tong J. Galaxy Morphology Classification Based on Dean&Francis Chenyu Zhao Deep Residual Network. Progress in Astronomy. 2022;41(2):45- 58.
[6] Jiang J, Schmidt K, Valiante E, Pakmor R, et al. Galaxy Morphology Classification Based on Convolutional Vision Transformer. Astronomy & Astrophysics. 2024;683:A102.
[7] Bowles M, Scaife AMM, Porter F, et al. Attention-gating for Improved Radio Galaxy Classification. Monthly Notices of the Royal Astronomical Society. 2021;501(3):4579–4595.
[8] Mnih V, Heess N, Graves A, et al. Recurrent Models of Visual Attention. Advances in Neural Information Processing Systems. 2014;27.
[9] Hochreiter S, Schmidhuber J. Long Short-Term Memory. Neural Computation. 1997;9(8):1735–1780.
[10] Jetley S, Lord NA, Lee N, et al. Learn to Pay Attention. arXiv preprint arXiv:1804.02391. 2018.
[11] Tang H, Scaife AMM, Leahy JP. Classifying Radio Galaxies with Deep Convolutional Neural Networks. Monthly Notices of the Royal Astronomical Society. 2019;488(3):3358–3376.
[12] Porter F. MiraBest Batched Dataset[DS]. Zenodo; 2020. DOI: 10.5281/zenodo.4288837.
[13] Zhang Y, Liang G, Su Y, et al. Multi-Branch Attention Networks for Classifying Galaxy Clusters. arXiv preprint. 2021.
[14] He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016:770-778.
[15] Jetley S, Lord NA, Lee N, et al. Learn to Pay Attention. arXiv preprint arXiv:1804.02391. 2018.
[16] Bellemare MG, Danihelka I, Dabney W, et al. The Cramér Distance as a Solution to Biased Wasserstein Gradients. arXiv preprint arXiv:1705.10743. 2017.
[17] Nelson D, Pillepich A, Springel V, et al. The IllustrisTNG Simulations: Public Data Release. Computational Astrophysics and Cosmology. 2019;6(1):1-24.
[18] Ma B, Qiu B, Luo A, et al. Galaxy Morphological Classification Using Dynamic Multiscale Attention Network. Monthly Notices of the Royal Astronomical Society. 2025;541:1928–1939.
[19] Radford A, Kim JW, Hallacy C, et al. Learning Transferable Visual Models from Natural Language Supervision. International Conference on Machine Learning. PMLR; 2021:8748–8763.
[20] Walmsley M, Lintott C, Géron T, et al. Galaxy Zoo DECaLS: Detailed Morphological Classifications from Volunteers and Deep Learning for 314,000 Galaxies. Monthly Notices of the Royal Astronomical Society. 2022;509(3):3966– 3988.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 by the authors.

This work is licensed under a Creative Commons Attribution 4.0 International License.
