HiT-LIDIA: A Framework for Rice Leaf Disease Classification using Ensemble and Hierarchical Transfer Learning

  • Oddy Virgantara Putra Universitas Darussalam Gontor
  • Niken Trisnaningrum Universitas Darussalam Gontor
  • Niken Sylvia Puspitasari Universitas Darussalam Gontor
  • Agung Toto Wibowo Telkom University
  • Ema Rachmawaty Telkom University


Rice is one of the global most critical harvests, and a great many people eat it as a staple eating routine. Different rice plant diseases harm, spread, and drastically reduce crop yields. In extreme situations, they may result in no grain harvest at all, posing a severe threat to food security. In this paper, to amplify the recognition ability for rice leaf disease (RLD) classification, we proposed hierarchical transfer learning (HTL) methods incorporating ensemble models containing two-step. In the first step, an ensemble combining MobileNet and DenseNet was addressed to tackle the diseased leaf problem. Consequently, DenseNet and XceptionNet were fused to identify three RLDs. Here, we compare our models with state-of-the-art deep learning models such as ResNet, DenseNet, InceptionNet, Xception, MobileNet, and EfficientNet. Our framework at top-notch with 89 % and 91 % for accuracy. In future works, RLD segmentation is suggested to pinpoint the illness and quantify the afflicted region.


Download data is not yet available.


[1] R. Deng, M. Tao, H. Xing, X. Yang, C. Liu, K. Liao, and L. Qi, “Automatic Diagnosis of Rice Diseases using Deep Learning,” Frontiers in Plant Science, vol. 12, 2021.
[2] D. Li, R. Wang, C. Xie, L. Liu, J. Zhang, R. Li, F. Wang, M. Zhou, and W. Liu, “A Recognition Method for Rice Plant Diseases and Pests Video Detection based on Deep Convolutional Neural Network,” Sensors (Switzerland), vol. 20, 2020.
[3] Y. Lu, S. Yi, N. Zeng, Y. Liu, and Y. Zhang, “Identification of Rice Diseases Using Deep Convolutional Neural Networks,” Neurocomputing, vol. 267, pp. 378–384, 2017. [Online]. Available: http://dx.doi.org/10.1016/j.neucom.2017.06.023
[4] F. Jiang, Y. Lu, Y. Chen, D. Cai, and G. Li, “Image Recognition of Four Rice Leaf Diseases based on Deep Learning and Support Vector Machine,” Computers and Electronics in Agriculture, vol. 179, p. 105824, 2020. [Online]. Available: https://doi.org/10.1016/j.compag.2020.105824
[5] C. R. Rahman, P. S. Arko, M. E. Ali, M. A. I. Khan, S. H. Apon, F. Nowrin, and A. Wasif, “Identification and Recognition of Rice Diseases and Pests using Convolutional Neural Networks,” Biosystems Engineering, vol. 194, pp. 112–120, 2020. [Online]. Available: https://doi.org/10.1016/j.biosystemseng.2020.03.020
[6] G. An, M. Akiba, K. Omodaka, T. Nakazawa, and H. Yokota, “Hierarchical Deep Learning Models using Transfer Learning for Disease Detection and Classification based on Small Number of Medical Images,” Scientific Reports, vol. 11, p. 4250, 3 2021. [Online]. Available: https://doi.org/10.1038/s41598-021-83503-7
[7] R. Gandhi, S. Nimbalkar, N. Yelamanchili, and S. Ponkshe, “Plant Disease Detection using CNNs and Gans as an Augmentative Approach,” 2018, pp. 1–5.
[8] M. Sardogan, A. Tuncer, and Y. Ozen, “Plant Leaf Disease Detection and Classification based on CNN with LVG Algorithm,” UBMK 2018 - 3rd International Conference on Computer Science and Engineering, pp. 382–385, 2018.
[9] G. Zhou, W. Zhang, A. Chen, M. He, and X. Ma, “Rapid Detection of Rice Disease based on FCM-KM and Faster R-CNN Fusion,” IEEE Access, vol. 7, pp. 143 190–143 206, 2019.
[10] E. C. Tetila, B. B. Machado, G. Astolfi, N. A. de Souza Belete, W. P. Amorim, A. R. Roel, and H. Pistori, “Detection and Classification of Soybean Pests using Deep Learning with UAV Images,” Computers and Electronics in Agriculture, vol. 179, 2020.
[11] Y. Wang, H. Wang, and Z. Peng, “Rice Diseases Detection and Classification using Attention based Neural Network and bayesian optimization,” Expert Systems with Applications, vol. 178, p. 114770, 2021. [Online]. Available: https://doi.org/10.1016/j.eswa.2021.114770
[12] P. Temniranrat, K. Kiratiratanapruk, A. Kitvimonrat, W. Sinthupinyo, and S. Patarapuwadol, “A system for Automatic Rice Disease Detection from Rice Paddy Images Serviced via a Chatbot,” Computers and Electronics in Agriculture, vol. 185, p. 106156, 2021. [Online]. Available: https://doi.org/10.1016/j.compag.2021.106156
[13] P. K. Sethy, N. K. Barpanda, A. K. Rath, and S. K. Behera, “Deep Feature based Rice Leaf Disease Identification using Support Vector Machine,” Computers and Electronics in Agriculture, vol. 175, p. 105527, 2020. [Online]. Available: https://doi.org/10.1016/j.compag.2020.105527
[14] S. A. Alidrus, A. Musthafa, and O. V. Putra, “Deteksi Penyakit pada Daun Tanaman Padi menggunakan Metode Convolutional Neural Network,” 2021, pp. 103–109.
[15] S. Ghosal and K. Sarkar, “Rice Leaf Diseases Classification using CNN with Transfer Learning,” 2020, pp. 30–236.
[16] Z. Jiang, Z. Dong, W. Jiang, and Y. Yang, “Recognition of Rice Leaf Diseases and Wheat Leaf Diseases based on Multi-Task Deep Transfer Learning,” Computers and Electronics in Agriculture, vol. 186, p. 106184, 2021. [Online]. Available: https://doi.org/10.1016/j.compag.2021.106184
[17] K. KC, Z. Yin, M. Wu, and Z. Wu, “Depthwise Separable Convolution Architectures for Plant Disease Classification,” Computers and Electronics in Agriculture, vol. 165, p. 104948, 2019.
[Online]. Available: https://www.sciencedirect.com/science/article/pii/S0168169918318696
[18] H. B. Prajapati, J. P. Shah, and V. K. Dabhi, “Detection and Classification of Rice Plant Diseases,” Intelligent Decision Technologies, vol. 11, pp. 357–373, 2017.
[19] S. T. Cynthia, K. M. S. Hossain, M. N. Hasan, M. Asaduzzaman, and A. K. Das, “Automated Detection of Plant Diseases using Image Processing and Faster R-CNN Algorithm,” 2019 International Conference on Sustainable Technologies for Industry 4.0, STI 2019, vol. 0, pp. 24–25, 2019.
[20] N. Duong-Trung, L.-D. Quach, M.-H. Nguyen, and C.-N. Nguyen, “Classification of Grain Discoloration via Transfer Learning and Convolutional Neural Networks.” Association for Computing Machinery, 2019, p. 27–32. [Online]. Available: https://doi.org/10.1145/3310986.3310997
[21] G. Huang, Z. Liu, L. V. D. Maaten, and K. Q. Weinberger, “Densely Connected Convolutional Networks,” 2017, pp. 4700–4708.
[22] A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications,” CoRR, vol. abs/1704.0, 2017. [Online]. Available: http://arxiv.org/abs/1704.04861
[23] H. B. F. David, A. Suruliandi, and S. P. Raja, “Stacked Framework for Ensemble of Heterogeneous Classification Algorithms,” Journal of Circuits, Systems and Computers, vol. 30, p. 2150269, 2021. [Online]. Available: https://doi.org/10.1142/S0218126621502698
[24] V. Tayanov, A. Krzyzak, and C. Y. Suen, “Ensemble Learning using Matrices of Classifier Interactions and Decision Profiles on Riemannian and Grassmann Manifolds,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 35, p. 2160011, 2021. [Online].
Available: https://doi.org/10.1142/S0218001421600119
[25] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. E. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going Deeper with Convolutions,” CoRR, vol. abs/1409.4, 2014. [Online]. Available: http://arxiv.org/abs/1409.4842
[26] F. Chollet, “Xception: Deep Learning with Depthwise Separable Convolutions,” 2017, pp. 1800–1807.
[27] J. Chen, D. Zhang, A. Zeb, and Y. A. Nanehkaran, “Identification of Rice Plant Diseases using Lightweight Attention Networks,” Expert Systems with Applications, vol. 169, p. 114514, 2021. [Online]. Available: https://doi.org/10.1016/j.eswa.2020.114514
How to Cite
PUTRA, Oddy Virgantara et al. HiT-LIDIA: A Framework for Rice Leaf Disease Classification using Ensemble and Hierarchical Transfer Learning. Lontar Komputer : Jurnal Ilmiah Teknologi Informasi, [S.l.], v. 13, n. 3, p. 196-207, dec. 2022. ISSN 2541-5832. Available at: <https://ojs.unud.ac.id/index.php/lontar/article/view/84026>. Date accessed: 26 jan. 2023. doi: https://doi.org/10.24843/LKJITI.2022.v13.i03.p06.