Pavement Distress Analysis in Malaysia: A Novel DeepSeg-CrackNet Model for Crack Detection and Characterization Using Real-World Data
Article Sidebar
Main Article Content
Abstract
Pavement distress analysis plays a big role in keeping roads in good shape, especially in busy spots like Selangor and Kuala Lumpur, where heavy traffic and tropical weather make them wear out fast. This work introduces DeepSeg-CrackNet, a fresh hybrid deep learning model that uses Deep Gradient ResNet to spot cracks and a Residual block with a Modified Attention Mechanism to sort them into types, making it simpler to detect and label pavement damage. The model was trained on real data collected from Malaysian roads, with the CRACK500 dataset added in to cover more situations, and captured using a GoPro Hero 8 mounted on a vehicle, with GPS mapping keeping everything clear and easy to trace. DeepSeg-CrackNet performs really well—it hits a Mean IoU of 0.8388889 for segmentation and scores 85% accuracy in classifying cracks like alligator, longitudinal, and transverse, with precision ranging from 0.84 to 0.89, and recall between 0.80 and 0.96. It also measures cracks in meters or square meters, which helps in planning repairs smartly, like replacing big alligator cracks or sealing smaller longitudinal ones to save resources. Compared to models like CrackNet, DeepSeg-CrackNet stands out, especially for alligator cracks, with a precision of 0.84 and recall of 0.96, beating CrackNet’s 0.778 and 0.772. In the end, DeepSeg-CrackNet makes it easier to manage Malaysia’s roads in a data-driven way, improving safety and ensuring longer-lasting infrastructure through smarter, proactive repair approaches that enhance city travel.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
M. N. Mahmud et al., “Crack detection on asphalt road in malaysia using UAV images and YOLOv4,” in 2024 IEEE 14th International Conference on Control System, Computing and Engineering (ICCSCE), Penang, Malaysia, Aug. 2024, pp. 64–69. doi: 10.1109/ICCSCE61582.2024.10696027.
A. Ashraf, A. Sophian, A. A. Shafie, T. S. Gunawan, and N. N. Ismail, “Machine learning-based pavement crack detection, classification, and characterization: a review,” Bulletin of Electrical Engineering and Informatics, vol. 12, no. 6, pp. 3601–3619, Dec. 2023, doi: 10.11591/eei.v12i6.5345.
A. Ashraf, A. Sophian, A. A. Shafie, T. S. Gunawan, N. N. Ismail, and A. A. Bawono, “Detection of road cracks using convolutional neural networks and threshold segmentation,” Journal of Integrated and Advanced Engineering (JIAE), vol. 2, no. 2, pp. 123–134, Sep. 2022, doi: 10.51662/jiae.v2i2.82.
R. Zhang, Y. Shi, and X. Yu, “Pavement crack detection based on deep learning,” in 2021 33rd Chinese Control and Decision Conference (CCDC), Kunming, China, May 2021, pp. 7367–7372. doi: 10.1109/CCDC52312.2021.9602216.
D. Arya, H. Maeda, S. K. Ghosh, D. Toshniwal, and Y. Sekimoto, “RDD2020: An annotated image dataset for automatic road damage detection using deep learning,” Data in Brief, vol. 36, p. 107133, Jun. 2021, doi: 10.1016/j.dib.2021.107133.
Y. Zhao, L. Zhou, X. Wang, F. Wang, and G. Shi, “Highway crack detection and classification using UAV remote sensing images based on CrackNet and CrackClassification,” Applied Sciences, vol. 13, no. 12, p. 7269, Jun. 2023, doi: 10.3390/app13127269.
A. Ashraf, A. Sophian, A. Akramin Shafie, T. Surya Gunawan, N. N. Ismail, and A. Aryo Bawono, “RCD-IIUM: A comprehensive malaysian road crack dataset for infrastructure analysis,” in 2024 9th International Conference on Mechatronics Engineering (ICOM), IEEE, Aug. 2024, pp. 200–206. doi: 10.1109/ICOM61675.2024.10652339.
P. Chun, T. Yamane, and Y. Tsuzuki, “Automatic detection of cracks in asphalt pavement using deep learning to overcome weaknesses in images and GIS visualization,” Applied Sciences, vol. 11, no. 3, p. 892, Jan. 2021, doi: 10.3390/app11030892.
G. Li, X. Li, J. Zhou, D. Liu, and W. Ren, “Pixel-level bridge crack detection using a deep fusion about recurrent residual convolution and context encoder network,” Measurement, vol. 176, p. 109171, May 2021, doi: 10.1016/j.measurement.2021.109171.
H. Oliveira and P. L. Correia, “Automatic road crack segmentation using entropy and image dynamic thresholding,” in 2009 17th European Signal Processing Conference (EUSIPCO), Glasgow, UK, Aug. 2009, pp. 622–626.
H. Oliveira and P. L. Correia, “Automatic road crack detection and characterization,” IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 1, pp. 155–168, Mar. 2013, doi: 10.1109/TITS.2012.2208630.
L. Zhang, F. Yang, Y. Daniel Zhang, and Y. J. Zhu, “Road crack detection using deep convolutional neural network,” in 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA, Sep. 2016, pp. 3708–3712. doi: 10.1109/ICIP.2016.7533052.
L. Ali, H. AlJassmi, M. Swavaf, W. Khan, and F. Alnajjar, “Rs-net: Residual sharp U-Net architecture for pavement crack segmentation and severity assessment,” Journal of Big Data, vol. 11, no. 1, p. 116, Aug. 2024. doi: 10.1186/s40537-024-00981-y.
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, real-time object detection,” arXiv, 2016, arXiv:1506.02640. doi: 10.48550/arXiv.1506.02640.
A. Zhang et al., “Deep learning–based fully automated pavement crack detection on 3D asphalt surfaces with an improved CrackNet,” Journal of Computing in Civil Engineering, vol. 32, no. 5, Sep. 2018, Art. no. 04018044. doi: 10.1061/(ASCE)CP.1943-5487.0000775.
K. He, G. Gkioxari, P. Dollar, and R. Girshick, “Mask R-CNN,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 2, pp. 386–397, Feb. 2020. doi: 10.1109/TPAMI.2018.2844175.
G. Jocher, A. Chaurasia, and J. Qiu, “Ultralytics YOLOv8,” Ultralytics, 2023, version 8.0.0. [Online]. Available: https://github.com/ultralytics/ultralytics.
J. Hu, L. Shen, S. Albanie, G. Sun, and E. Wu, “Squeeze-and-excitation networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 8, pp. 2011–2023, Aug. 2020. doi: 10.1109/TPAMI.2019.2913372.
N. A. M. Yusof, M. K. Osman, M. H. M. Noor, A. Ibrahim, N. M. Tahir, and N. M. Yusof, “Crack detection and classification in asphalt pavement images using deep convolution neural network,” in 2018 8th IEEE International Conference on Control System, Computing and Engineering (ICCSCE), Penang, Malaysia, Nov. 2018, pp. 227–232. doi: 10.1109/ICCSCE.2018.8685007.
M. Nie and C. Wang, “Pavement Crack Detection based on YOLOv3,” in 2019 2nd International Conference on Safety Produce Informatization (IICSPI), Chongqing, China, Nov. 2019, pp. 327–330. doi: 10.1109/IICSPI48186.2019.9095956.
P.-W. Chin, K.-W. Ng, and N. Palanichamy, “Plant Disease Detection and Classification Using Deep Learning Methods: A Comparison Study,” Journal of Informatics and Web Engineering, vol. 3, no. 1, pp. 155–168, Feb. 2024. doi: 10.33093/jiwe.2024.3.1.10.
U. Ali, Maizatul Akmar Ismail, Riyaz Ahamed Ariyaluran Habeeb, and Syed Roshaan Ali Shah, “Performance Evaluation of YOLO Models in Plant Disease Detection,” Journal of Informatics and Web Engineering, vol. 3, no. 2, pp. 199–211, Jun. 2024. doi: 10.33093/jiwe.2024.3.2.15.