A Data Augmented Method for Plant Disease Leaf Image Recognition based on Enhanced GAN Model Network
Article Sidebar
Main Article Content
Abstract
The identification of plant disease leaves based on deep learning is the key to control the development and spread of plant diseases. In this paper, the existing problems of traditional classification and recognition of plant disease leaves and the limitations of deep learning-based plant disease leaf training are analysed. An enhanced GAN model network based on the Wasserstein GAN loss function has been developed to address the limited training images of plant disease leaves. The self-attention layer is added into the self-encoding structure of the generating network. The effectiveness of data generated by the encoder is increased after the self-attention layer is added after the convolution. Finally, the model's training process is stabilised using the depth gradient punishment method. Three types of corn disease photos and 100 health images from the PlantVillage dataset were used as data sets in the experiment. An AWGAN model was applied to generate around 3000 images. Several data improvement techniques were applied to augment the same datasets. Comparative tests are conducted using AlexNet, VGG16, and ResNet18. The results indicate that the proposed AWGAN model is capable of generating sufficient images of maize leaf diseases with apparent lesions, making it a viable solution for data augmentation of plant disease images. The training model's recognition accuracy is significantly increased. The proposed awGAN-based image identification method for plant leaf disease efficiently resolves the over-fitting problem in the small sample training set. The model recognition accuracy in the ResNet18 network achieves 98.4%.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
H. Yang, J. Zhang, and X. Li, “Research on remote insect automatic recognition system based on image”, Transactions of the Chinese society of agricultural engineering, vol .24, no. 1, pp. 188-192, 2019.
S. Neethirajan, C. Karunakaran, D. Jayas, and N. White, “Detection techniques for stored-product insects in grain”, Food Control, vol. 18, no. 2, pp. 157-162, 2007. doi.org/10.1016/j.foodcont.2005.09.008.
H. Zhang and H. Mao, “Application of coarse centralization weights based on FCM discretization in extension classification of grain insects”, Transactions of the Chinese society for agricultural machinery, vol. 39, no. 7, pp. 124-128, 2008.
M. H. Hesamian, W. Jia, X. He, and P. Kennedy, “Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges”, Journal of Digital Imaging, vol. 32, no. 4, pp. 582–596, 2019. doi: 10.1007/s10278-019-00227-x.
I. Goodfellow, "Data Augmentation of Grape Leaf Diseases Based on Generative Adversarial Network",vol. 3, no. 1 ,pp 134-136, 2021.
H. Zhang, I. Goodfellow, D. Metaxas, and A. Odena, "Self-Attention Generative Adversarial Networks", International Conference on Machine Learning, vol. 97, pp. 7354-7363, 2019. doi: 10.48550/arXiv.1805.08318.
J. Zhang, F. Kong, et al., “Cotton disease recognition model based on improved VGG convolutional neural network”, Journal of China Agricultural University, vol. 23, no. 11, pp. 161-171, 2018.
M. Li, H .Zhu, H. Chen, L. Xue, T. Gao ,"Research on object detection algorithm based on deep learning", Journal of Physics: Conference Series. vol. 1995, no. 1, IOP Publishing, 2021.
Y. Ma, Z. Luo, Z. Ni, et al., “Improved SSD algorithm for multi-object detection”, Computer engineering and applications, vol. 56, no. 23, pp. 23-30, 2020.
N. Natarajan, I. S. Dhillon, P. Ravikumar, et al., “Learning with noisy labels”, Neural Information Processing Systems (NIPS), vol. 26, pp. 1196-1204, 2013.
S. E. A. Raza, G. Prince, J. P. Clarkson, and N. M. Rajpoot, “Automatic detection of diseased tomato plants using thermal and stereo visible light images”, PLOS One, vol. 10, no. 4, pp. 1–20, 2015. doi: 10.1371/journal.pone.0123262.
S. P. Mohanty, D. P. Hughes, and M. Salathe, “Using deep learning for image-based plant disease detection”, Frontiers in Plant Science, vol. 7, pp. 1–10, 2016. doi: 10.3389/fpls.2016.01419.
W.Bao, G. Wu, "Apple leaf disease recognition based on improved convolutional neural network", Sensors, vol. 20, no. 12, pp. 3535, 2021. doi: 10.3390/s20123535.
Z. Shanwen and W. Zhen, “Image segmentation method of cucumber disease leaves based on multi-scale Fusion convolutional Neural network”, Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), vol. 36, no. 16, pp. 149-157, 2020. doi: 10.11975/j. issn.1002-6819.2020.16.019.
Z. Chen, Y. Fu, Y. Zhang, Y. G. Jiang, X. Xue, and L. Sigal, “Multi-Level Semantic Feature Augmentation for One-Shot Learning”, IEEE Transactions on Image Processing, vol. 28, no. 9, pp. 4594–4605, 2019. doi: 10.1109/TIP.2019.2910052.
S. Ye, K. Wu, M. Zhou, Y. Yang, S.H. Tan, K. Xu, J. Song, C. Bao, K. Ma, “Light-weight Calibrator: A Separable Component for Unsupervised Domain Adaptation”, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13733–13742, 2020. doi: 10.1109/CVPR42600.2020.01375.
F. Deng, S. Pu, X. Chen, Y. Shi, T. Yuan, and P. Shengyan, “Hyperspectral image classification with capsule network using limited training samples”, Sensors, vol. 18, no. 9, 3153, 2018. doi: 10.3390/s18093153.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks Handbook of Approximation Algorithms and Metaheuristics, pp. 1–1432, 2007. doi: 10.1201/9781420010749.
W. Meiqin, Y. Weiwei, and Z. Jiye. "Overview of Research on Generative Adversarial Network GAN", Computer engineering and design, vol.42, no. 12, pp. 3389-3395, 2021.
Z. Zhibo, T. Qizhi, R. Chao, H. Xiaohai, and Z. Sen, “Unsupervised image super-resolution algorithm based on Generative Adversarial Network”, Information Technology & Network Security/Xinxi Jishu yu Wangluo Anquan, vol. 41, no. 1, pp. 55–62, 2022. doi: 10.19358/j.issn.2096-5133.2022.01.009.
I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative Adversarial Networks”, Advances in Neural Information Processing Systems” 2014. doi: 3. 10.1145/3422622.
M. Arjovsky, S. Chintala, and L. Bottou, “"Wasserstein Generative Adversarial Networks", International Conference on Machine Learning, vol. 70, pp. 214–223, 2017. doi: 10.48550/arXiv.1701.07875.
K. H. Fanchiang, Y. C. Huang, and C. C. Kuo, “Power electric transformer fault diagnosis based on infrared thermal images using wasserstein generative adversarial networks and deep learning classifier”, Electronics, vol. 10, no. 10, 1161, 2021. doi: 10.3390/electronics10101161.
D. Wang, H. Hu, and D. Chen, “Transformer with sparse self-attention mechanism for image captioning”, Electronics Letters, vol. 56, no. 15, 2020, pp. 764–766. doi: 10.1049/el.2020.0635.
M. Mirza and S. Osindero, “Conditional Generative Adversarial Nets”, arXiv, pp. 1–7, 2014. doi: 10.48550/arXiv.1411.1784.
S. Kiranyaz, O. Avci, O. Abdeljaber, T. Ince, M. Gabbouj, and D. J. Inman, “1D convolutional neural networks and applications: A survey”, Mechanical Systems and Signal Processing, vol. 151, 2021, doi: 10.1016/j.ymssp.2020.107398.
C. Chu, A. Zhmoginov, and M. Sandler, “CycleGAN, a Master of Steganography”, Neural Information Processing Systems, pp. 1–6, 2017. doi: 10.48550/arXiv.1712.02950.
Q. H. Cap, H. Uga, S. Kagiwada, and H. Iyatomi, “LeafGAN: An Effective Data Augmentation Method for Practical Plant Disease Diagnosis”, IEEE Transactions on Automation Science and Engineering, vol. 19, no. 2, pp. 1258-1267, 2020. doi: 10.1109/TASE.2020.3041499.