Effectiveness of Hybrid Quantum-Classical and Quanvolutional Neural Networks for image classification

Authors

DOI:

https://doi.org/10.20535/2786-8729.5.2024.318743

Keywords:

Neural Networks, Quantum Computing, Hybrid Neural Networks, Image Classification

Abstract

The article focuses on studying the effectiveness of two different Hybrid Neural Networks (HNNs) architectures for solving real-world image classification problems. The first approach investigated in the research is a hybridization technique that allows creation of HNN based on a classical neural network by replacing a number of hidden layers of the neural network with a variational quantum circuit, which allows to reduce the complexity of the classical part of the neural network and move part of computations to a quantum device. The second approach is a hybridization technique based on utilizing quanvolutional operations for image processing as the first quantum convolutional layer of the hybrid neural network, thus building a Quanvolutional Neural Network (QNN). QNN leverages quantum phenomena to facilitate feature extraction, enabling the model to achieve higher accuracy metrics than its classical counterpart.

The effectiveness of both architectures was tested on several image classification problems. The first one is a classical image classification problem of CIFAR10 images classification, widely used as a benchmark for various imagery-related tasks. Another problem used for the effectiveness study is the problem of geospatial data analysis. The second problem represents a real-world use case where quantum computing utilization can be very fruitful in the future. For studying the effectiveness, several models were assembled: HNN with a quantum device that replaces one of the hidden layers of the neural network, QNN based on quanvolutional operation and utilizes VGG-16 architecture as a classical part of the model, and also an unmodified VGG-16 was used as a reference model. Experiments were conducted to measure the models' key efficiency metrics: maximal accuracy, complexity of a quantum part of the model and complexity of a classical part of the model.

The results of the research indicated the feasibility of both approaches for solving both proposed image classification problems. Results were analyzed to outline the advantages and disadvantages of every approach in terms of selected key metrics. Experiments showed that QNN architectures proved to be a feasible and effective solution for critical practical tasks requiring higher levels of model prediction accuracy and, simultaneously, can tolerate higher processing time and significantly increased costs due to a high number of quantum operations required. Also, the results of the experiments indicated that HNN architectures proved to be a feasible solution for time-critical practical tasks that require higher processing speed and can tolerate slightly decreased accuracy of model predictions.

Author Biographies

Yevhenii Trochun, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”, Kyiv

PhD student of the Computer Engineering Department of the Faculty of informatics and Computer Technique

Yuri Gordienko, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”, Kyiv, Ukraine

Professor of the Computer Engineering Department of the Faculty of Informatics and Computer Technique, Doctor of Sciences in Physics and Mathematics, Senior Research Fellow

References

F. Fan, Y. Shi, T. Guggemos and X. X. Zhu, "Hybrid Quantum-Classical Convolutional Neural Network Model for Image Classification." In IEEE Transactions on Neural Networks and Learning Systems, vol. 35, no. 12, pp. 18145–18159, Dec. 2024, https://doi.org/10.1109/TNNLS.2023.3312170.

Hafeez MA, Munir A, Ullah H., "H-QNN: A Hybrid Quantum–Classical Neural Network for Improved Binary Image Classification." AI, vol. 5(3), pp. 1462–1481, Aug. 2024. https://doi.org/10.3390/ai5030070.

Cong, I., Choi, S. & Lukin, M.D. "Quantum convolutional neural networks." Nat. Phys., vol. 15, pp. 1273–1278, Aug. 2019. https://doi.org/10.1038/s41567-019-0648-8.

Cerezo, M., Arrasmith, A., Babbush, R. et al., "Variational quantum algorithms." Nat. Rev. Phys., vol. 3, pp. 625–644, Aug. 2021. https://doi.org/10.1038/s42254-021-00348-9.

Mari, Andrea, et al. "Transfer Learning in Hybrid Classical-Quantum Neural Networks." Quantum, vol. 4, p. 340, Oct. 2020. https://doi.org/10.22331/q-2020-10-09-340.

John Preskill, "Quantum Computing in the NISQ era and beyond." Quantum, vol. 2, p. 79, Jul. 2018. https://doi.org/10.22331/q-2018-08-06-79.

Xiangyu Zhang, Jianhua Zou, Kaiming He, Jian Sun, "Accelerating Very Deep Convolutional Networks for Classification and Detection." In arXiv:1505.06798, Nov. 2015. https://doi.org/10.48550/arXiv.1505.06798.

Dan Shepherd, "On the Role of Hadamard Gates in Quantum Circuits." In arXiv:quant-ph/0508153, Mar. 2006. https://doi.org/10.48550/arXiv.quant-ph/0508153.

Yevhenii Trochun, Sergii Stirenko, Evgen Pavlov, Yuri Gordienko, "Impact of Hybrid Neural Network Structure on Performance of Multiclass Classification." In Proceedings of the IEEE 19th International Conference on Smart Technologies, EUROCON’2021, pp. 152-156, Jul. 2021. https://doi.org/10.1109/EUROCON52738.2021.9535586.

Krizhevsky, A., & Hinton, G. (2009). "Learning multiple layers of features from tiny images." Accessed on Dec. 17, 2024. [Online]. Available: https://www.cs.toronto.edu/kriz/learning-features- 2009-TR.pdf.

"CIFAR10 and CIFAR100 datasets." Accessed on: Dec. 17, 2024. [Online]. Available: https://www.cs.toronto.edu/ kriz/cifar.html

Quoc Dung Cao, Youngjun Choe, "Building Damage Annotation on Post-Hurricane Satellite Imagery Based on Convolutional Neural Networks." Natural Hazards, vol. 3, pp. 3357–3376, Jul. 2020. https://doi.org/10.1007/s11069-020-04133-2.

"Hybrid quantum-classical Neural Networks with PyTorch and Qiskit." Accessed on: Dec. 17, 2024. [Online]. Available: https://qiskit.org/textbook/ch-machine-learning/machine-learning- qiskit-pytorch.html.

K. Fukushima, "Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position." Biological Cybernetics, vol. 36, pp. 193–202, Apr. 1980. https://doi.org/10.1007/BF00344251.

Han, Jun; Morag, Claudio, "The influence of the sigmoid function parameters on the speed of backpropagation learning." In Mira, José; Sandoval, Francisco (eds.). From Natural to Artificial Neural Computation. Lecture Notes in Computer Science, vol. 930. pp. 195–201, Jan. 2005. https://doi.org/10.1007/3-540-59497-3_175.

Maxwell Henderson, Samriddhi Shakya, Shashindra Pradhan, Tristan Cook, "Quanvolutional Neural Networks: Powering Image Recognition with Quantum Circuits." In arxiv:1904.04767, Apr. 2019. https://doi.org/10.48550/arXiv.1904.04767.

Gordienko Y, Trochun Y, Stirenko S, "Multimodal Quanvolutional and Convolutional Neural Networks for Multi-Class Image Classification." Big Data and Cognitive Computing, vol. 8(7), р. 75, Jul. 2024. https://doi.org/10.3390/bdcc8070075.

Trochun, Y.; Wang, Z.; Rokovyi, O.; Peng, G.; Alienin, O.; Lai, G.; Gordienko, Y.; Stirenko, S., "Hurricane Damage Detection by Classic and Hybrid Classic-Quantum Neural Networks." In Proceedings of the International Conference on Space-Air-Ground Computing (SAGC), pp. 152-156, Oct. 2021. https://doi.org/10.1109/SAGC52752.2021.00033.

"Qiskit." Accessed on: Dec. 17, 2024. [Online]. Available: https://qiskit.org/documentation/.

"Quanvolutional Neural Networks." Accessed on: Dec. 17, 2024. [Online]. Available: https://github.com/ZheniaTrochun/quanvolutional-neural-networks.

"Quantum Deep Learning." Accessed on: Dec. 17, 2024. [Online]. Available: https://github.com/ZheniaTrochun/quantum-deep-learning.

"Quantum-Augmented CIFAR100." Accessed on: Dec. 17, 2024. [Online]. Available: https://www.kaggle.com/datasets/yevheniitrochun/quantum-augmented-cifar100.

"Quantum-Augmented Images of Hurricane Damage." Accessed on: Dec. 17, 2024. [Online]. Available: https://www.kaggle.com/datasets/yevheniitrochun/quantum-augmented-images-of-hurricane-damage-part1.

Downloads

Published

2024-12-26

How to Cite

[1]
Y. Trochun and Y. Gordienko, “Effectiveness of Hybrid Quantum-Classical and Quanvolutional Neural Networks for image classification”, Inf. Comput. and Intell. syst. j., no. 5, pp. 68–79, Dec. 2024.