Document Type : Original Article


Department of Computer Science and Technology, Henan Institute of Technology, Xinxiang 453003, China


One of the important and more challenging categories in the smart cities and IoT is to monitor the vehicles plate licenses. This system is a key factor in most of the traffic monitoring in the IoT based smart city applications. In this research, a method for plate license recognition based on optimal training of the CNN is proposed. To do this, the configuration and the hyperparameters of the CNN were optimized by a new hybrid optimization including world cup optimizer, whale optimizer, and chaotic theory to obtain a better result with high convergence. Simulations are applied to the UFPR-ALPR dataset and are compared with six popular techniques in terms of accuracy and time. Experimental achievements indicated that the proposed method gives superiority toward the other comparative techniques and is an efficient method for vehicles plate licenses detection.


How to cite this article
Sun D. IoT-based Automated Vehicle Plate Detection Algorithm for Urban Surveillance Systems by A New Hybrid Optimized CNN J. Journal of Smart Energy and Sustainability, 2022; 1(2): 105-115. 

[1]    M. A. Khan and K. Salah, “IoT security: Review, blockchain solutions, and open challenges,” Future Generation Computer Systems, vol. 82, pp. 395-411, 2018.
[2]    B. Farahani, F. Firouzi, V. Chang, M. Badaroglu, N. Constant, and K. Mankodiya, “Towards fog-driven IoT eHealth: Promises and challenges of IoT in medicine and healthcare,” Future Generation Computer Systems, vol. 78, pp. 659-676, 2018.
[3]    A. Dehghantanha, Handbook of Big Data and IoT Security: Springer, 2019.
[4]    F. Saghafi and H. Kordsalari, “Suggesting the Driving Forces Behind the Effective Implementation of the Internet of Things in the IRI Railway System with Focus on Improving Safety,” in 2018 9th International Symposium on Telecommunications (IST), 2018, pp. 375-380.
[5]    R. Jalali and S. Zeinali, “Smart Flight Security in Airport Using IOT (Case Study: Airport of Birjand),” International Journal of Computer Science and Software Engineering, vol. 7, pp. 142-147, 2018.
[6]    S. Khan, N. Islam, Z. Jan, I. U. Din, and J. J. C. Rodrigues, “A Novel Deep Learning based Framework for the Detection and Classification of Breast Cancer Using Transfer Learning,” Pattern Recognition Letters, 2019.
[7]    I. M. Baltruschat, H. Nickisch, M. Grass, T. Knopp, and A. Saalbach, “Comparison of deep learning approaches for multi-label chest X-ray classification,” Scientific reports, vol. 9, p. 6381, 2019.
[8]    G. Litjens, T. Kooi, B. E. Bejnordi, A. A. A. Setio, F. Ciompi, M. Ghafoorian, et al., “A survey on deep learning in medical image analysis,” Medical image analysis, vol. 42, pp. 60-88, 2017.
[9]    H. Rajput, T. Som, and S. Kar, “An automated vehicle license plate recognition system,” Computer, vol. 48, pp. 56-61, 2015.
[10]    B. Kolosnjaji, A. Zarras, G. Webster, and C. Eckert, “Deep learning for classification of malware system call sequences,” in Australasian Joint Conference on Artificial Intelligence, 2016, pp. 137-149.
[11]    M. Fu, N. Chen, X. Hou, H. Sun, A. Abdussalam, and S. Sun, “Real-Time Vehicle License Plate Recognition Using Deep Learning,” in International Conference On Signal And Information Processing, Networking And Computers, 2018, pp. 35-41.
[12]    L. Zhong, L. Hu, and H. Zhou, “Deep learning based multi-temporal crop classification,” Remote sensing of environment, vol. 221, pp. 430-443, 2019.
[13]    M. Admi, S. El Fkihi, and R. Faizi, “A Novel MSER based Method for Detecting Text in License Plates,” in Proceedings of the International Conference on Learning and Optimization Algorithms: Theory and Applications, 2018, p. 33.
[14]    K. Tejas, K. A. Reddy, D. P. Reddy, K. Bharath, R. Karthik, and M. R. Kumar, “Efficient License Plate Recognition System with Smarter Interpretation Through IoT,” in Soft Computing for Problem Solving, ed: Springer, 2019, pp. 207-220.
[15]    O. Abedinia, N. Amjady, and N. Ghadimi, “Solar energy forecasting based on hybrid neural network and improved metaheuristic algorithm,” Computational Intelligence, vol. 34, pp. 241-260, 2018.
[16]    P. Moallem and N. Razmjooy, “A multi layer perceptron neural network trained by invasive weed optimization for potato color image segmentation,” Trends in Applied Sciences Research, vol. 7, p. 445, 2012.
[17]    N. Razmjooy, B. S. Mousavi, and F. Soleymani, “A hybrid neural network Imperialist Competitive Algorithm for skin color segmentation,” Mathematical and Computer Modelling, vol. 57, pp. 848-856, 2013.
[18]    H. M. Kanoosh, E. H. Houssein, and M. M. Selim, “Salp Swarm Algorithm for Node Localization in Wireless Sensor Networks,” Journal of Computer Networks and Communications, vol. 2019, 2019.
[19]    U. R. Acharya, S. L. Oh, Y. Hagiwara, J. H. Tan, and H. Adeli, “Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals,” Computers in biology and medicine, vol. 100, pp. 270-278, 2018.
[20]    O. Abedinia, N. Amjady, and A. Ghasemi, “A new metaheuristic algorithm based on shark smell optimization,” Complexity, vol. 21, pp. 97-116, 2016.
[21]    N. Razmjooy, M. Khalilpour, and M. Ramezani, “A New Meta-Heuristic Optimization Algorithm Inspired by FIFA World Cup Competitions: Theory and Its Application in PID Designing for AVR System,” Journal of Control, Automation and Electrical Systems, vol. 27, pp. 419-440, 2016.
[22]    N. Razmjooy and M. Ramezani, “An Improved Quantum Evolutionary Algorithm Based on Invasive Weed Optimization,” Indian J. Sci. Res, vol. 4, pp. 413-422, 2014.
[23]    N. Ghadimi, “Genetically tuning of lead-lag controller in order to control of fuel cell voltage,” Scientific Research and Essays, vol. 7, pp. 3695-3701, 2012.
[24]    S. Mirjalili, “Genetic Algorithm,” in Evolutionary Algorithms and Neural Networks, ed: Springer, 2019, pp. 43-55.
[25]    B. S. Mousavi and F. Soleymani, “Semantic image classification by genetic algorithm using optimised fuzzy system based on Zernike moments,” Signal, Image and Video Processing, vol. 8, pp. 831-842, 2014.
[26]    N. Ghadimi, M. Afkousi-Paqaleh, and A. Nouri, “PSO based fuzzy stochastic long-term model for deployment of distributed energy resources in distribution systems with several objectives,” IEEE Systems Journal, vol. 7, pp. 786-796, 2013.
[27]    A. Jalili and N. Ghadimi, “Hybrid harmony search algorithm and fuzzy mechanism for solving congestion management problem in an electricity market,” Complexity, vol. 21, pp. 90-98, 2016.
[28]    J. C. Bansal, “Particle Swarm Optimization,” in Evolutionary and Swarm Intelligence Algorithms, ed: Springer, 2019, pp. 11-23.
[29]    P. Moallem and N. Razmjooy, “Optimal threshold computing in automatic image thresholding using adaptive particle swarm optimization,” Journal of applied research and technology, vol. 10, pp. 703-712, 2012.
[30]    N. Razmjooy and M. Ramezani, “Training Wavelet Neural Networks Using Hybrid Particle Swarm Optimization and Gravitational Search Algorithm for System Identification.”
[31]    I. Aljarah, H. Faris, and S. Mirjalili, “Optimizing connection weights in neural networks using the whale optimization algorithm,” Soft Computing, vol. 22, pp. 1-15, 2018.
[32]    S. Mirjalili and A. Lewis, “The whale optimization algorithm,” Advances in Engineering Software, vol. 95, pp. 51-67, 2016.
[33]    P. S. Bandaghiri, N. Moradi, and S. S. Tehrani, “Optimal tuning of PID controller parameters for speed control of DC motor based on world cup optimization algorithm,” parameters, vol. 1, p. 2, 2016.
[34]    N. Razmjooy, A. Madadi, and M. Ramezani, “Robust Control of Power System Stabilizer Using World Cup Optimization Algorithm.”
[35]    N. Razmjooy and M. Shahrezaee, “Solving Ordinary Differential Equations using World Cup Optimization Algorithm.”
[36]    N. Razmjooy, F. R. Sheykhahmad, and N. Ghadimi, “A hybrid neural network–world cup optimization algorithm for melanoma detection,” Open Medicine, vol. 13, pp. 9-16, 2018.
[37]    M. Shahrezaee, “Image segmentation based on world cup optimization algorithm,” Majlesi Journal of Electrical Engineering, vol. 11, 2017.
[38]    Y. Luo, J. Yu, W. Lai, and L. Liu, “A novel chaotic image encryption algorithm based on improved baker map and logistic map,” Multimedia Tools and Applications, pp. 1-21, 2019.
[39]    C. Schymura and D. Kolossa, “Learning Dynamic Stream Weights for Linear Dynamical Systems Using Natural Evolution Strategies,” in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2019, pp. 7893-7897.
[40]    UFPR-ALPR. (2019). UFPR-ALPR Available:
[41]    R. Laroca, E. Severo, L. A. Zanlorensi, L. S. Oliveira, G. R. Gonçalves, W. R. Schwartz, et al., “A robust real-time automatic license plate recognition based on the YOLO detector,” in 2018 International Joint Conference on Neural Networks (IJCNN), 2018, pp. 1-10.
[42]    S.-K. Chou, M.-K. Jiau, and S.-C. Huang, “Stochastic set-based particle swarm optimization based on local exploration for solving the carpool service problem,” IEEE transactions on cybernetics, vol. 46, pp. 1771-1783, 2016.
[43]    L. Bottou and O. Bousquet, “The tradeoffs of large scale learning,” in Advances in neural information processing systems, 2008, pp. 161-168.
[44]    A. P. U. Siahaan, “Vehicle Plate Recognition using Template Matching,” 2018.
[45]    S. Yu, B. Li, Q. Zhang, C. Liu, and M. Q.-H. Meng, “A novel license plate location method based on wavelet transform and EMD analysis,” Pattern Recognition, vol. 48, pp. 114-125, 2015.
[46]    K. M. A. Yousef, M. Al-Tabanjah, E. Hudaib, and M. Ikrai, “SIFT based automatic number plate recognition,” in 2015 6th International Conference on Information and Communication Systems (ICICS), 2015, pp. 124-129.
[47]    D. F. Llorca, R. Arroyo, and M. A. Sotelo, “Vehicle logo recognition in traffic images using HOG features and SVM,” in 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), 2013, pp. 2229-2234.
[48]    T. K. Cheang, Y. S. Chong, and Y. H. Tay, “Segmentation-free vehicle license plate recognition using ConvNet-RNN,” arXiv preprint arXiv:1701.06439, 2017.
[49]    C. Gou, K. Wang, Y. Yao, and Z. Li, “Vehicle license plate recognition based on extremal regions and restricted Boltzmann machines,” IEEE transactions on intelligent transportation systems, vol. 17, pp. 1096-1107, 2015.