CLASSIFICATION OF DATES QUALITY USING DEEP LEARNING TECHNOLOGY BASED ON CAPTURED IMAGES

Document Type : Original Article

Authors

1 Assoc. Prof., Ag. Eng. Dept., Fac. of Ag., Ain Shams U., Al Qalyubiyah, Egypt.

2 Head of Res. at the Plant Pathology Research Institute., Ag. Res. Center (A. R. C)., Giza, Egypt.

3 Assist. Prof., Ag. Eng. Dept., Fac. of Ag., Ain Shams U., Al Qalyubiyah, Egypt.

Abstract

Dates are a common fruit in many Middle Eastern and African nations and have religious and cultural value. one of the key elements in judging the quality of dates is sorting according to their health state. Combining rejected dates with accepted ones causes significant economic losses in both storage and exportation. Despite being a crucial stage for obtaining high-quality dates and reducing losses, this sorting process is still conducted using traditional methods. Thus, this study aims to classify date fruit quality (accepted or rejected) with machine learning technology to reduce cost, time, and improve the quality of final product. In this study, several Convolutional Neural Network architectures (Inception-v3, Inception-ResNet-v2, VGG19) were used to classify three varieties of date fruit (Mejdool, Saiedi, El-Wadi). These varieties were classified into accepted and rejected samples to build the dataset im-ages. An Arduino Automatic mobile camera shutter controller captured the dataset images. In addition to the Kaggle dataset which was added to the accepted images. The total dataset consisted of 5,945 images, comprising 3,142 accepted images and 2,803 rejected images. By comparing the results of different architectures, Inception-ResNet-v2 demonstrated the best performance, achieving an accuracy of 98.99% and a loss of 0.0344. Therefore, it can be concluded that the Inception-ResNet-v2 model could be utilized to develop a suitable computer vision system, thereby enhancing the date sorting process and facilitating the packaging of high-quality dates.

Keywords

Main Subjects

References

Adedeji, A.A., Ekramirad, N., Rady, A., Hamidisepehr, A., Donohue, K.D., Villanueva, R.T., Parrish, C.A.,and Li, M., 2020. Non-Destructive Technologies for Detecting Insect Infestation in Fruits and Vegetables under Postharvest Conditions: A Critical Review. Foods 9, 927. https://doi.org/10.3390/foods9070927.
Alhamdan, W.S.N., and Howe, J.M., 2021. Classification of Date Fruits in a Controlled Environment Using Convolutional Neural Networks, in: Hassanien, A.-E., Chang, K.-C., Mincong, T. (Eds.), Advanced Machine Learning Technologies and Applications, Advances in Intelligent Systems and Computing. Springer International Publishing, Cham, pp. 154–163. https://doi.org/10.1007/978-3-030-69717-4_16.
Alsirhani, A., Siddiqi, M.H., Mostafa, A.M., Ezz, M., and Mahmoud, A.A., 2023. A Novel Classification Model of Date Fruit Dataset Using Deep Transfer Learning. Electronics 12, 665. https://doi.org/10.3390/electronics12030665.
Alzubaidi, L., Zhang, J., Humaidi, A.J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M.A., Al-Amidie, M., and Farhan, L., 2021. Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data 8, 53. https://doi.org/10.1186/s40537-021-00444-8.
Azadnia, R., Fouladi, S., and Jahanbakhshi, A., 2023. Intelligent detection and waste control of hawthorn fruit based on ripening level using machine vision system and deep learning techniques. Results in Engineering 17, 100891. https://doi.org/10.1016/j.rineng.2023.100891.
Codex, 1985. CODEX STANDARD FOR DATES. FOOD AND AGRICULTURAL ORGANIZATION OF THE UNITED NATIONS, Codex Alimentarius 5.
Darwish, M., 2020. FRUIT CLASSIFICATION USING COVOLUTIONAL NEURAL NETWORK 67.
Dr.A, .Usha Ruby, 2020. Binary cross entropy with deep learning technique for Image classification. IJATCSE 9, 5393–5397. https://doi.org/10.30534/ijatcse/2020/175942020.
FAO, 2022. FAO Statistics. FOOD AND AGRICULTURAL ORGANIZATION OF THE UNITED NATIONS.
FAO, 2018. Strategy for developing the palm and palm trees sector in Egypt. FOOD AND AGRICULTURAL ORGANIZATION OF THE UNITED NATIONS 86.
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., and Chen, T., 2018. Recent advances in convolutional neural networks. Pattern Recognition 77, 354–377. https://doi.org/10.1016/j.patcog.2017.10.013.
Hassan, S.M., Maji, A.K., Jasiński, M., Leonowicz, Z., and Jasińska, E., 2021. Identification of Plant-Leaf Diseases Using CNN and Transfer-Learning Approach. Electronics 10, 1388. https://doi.org/10.3390/electronics10121388.
khayer, Md.A., Hasan, Md.S., and Sattar, A., 2021. Arabian Date Classification using CNN Algorithm with Various Pre-Trained Models, in: 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV). Presented at the 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), IEEE, Tirunelveli, India, pp. 1431–1436. https://doi.org/10.1109/ICICV50876.2021.9388413.
Kingma, D.P., and Ba, J., 2017. Adam: A Method for Stochastic Optimization.
Krizhevsky, A., Sutskever, I., and Hinton, G.E., 2017. ImageNet classification with deep convolutional neural networks. Commun. ACM 60, 84–90. https://doi.org/10.1145/3065386.
Li, Z., Liu, F., Yang, W., Peng, S., and Zhou, J., 2022. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects. IEEE Trans. Neural Netw. Learning Syst. 33, 6999–7019. https://doi.org/10.1109/TNNLS.2021.3084827.
M, H., M.N, S., 2015. A Review on Evaluation Metrics for Data Classification Evaluations. IJDKP 5, 01–11. https://doi.org/10.5121/ijdkp.2015.5201.
Mohanty, S.P., Hughes, D.P., and Salathé, M., 2016. Using Deep Learning for Image-Based Plant Disease Detection. Front. Plant Sci. 7, 1419
            . https://doi.org/10.3389/fpls.2016.01419.
Nasiri, A., Taheri-Garavand, A., and Zhang, Y.-D., 2019. Image-based deep learning automated sorting of date fruit. Postharvest Biology and Technology 153, 133–141. https://doi.org/10.1016/j.postharvbio.2019.04.003.
Nturambirwe, J.F.I., and Opara, U.L., 2020. Machine learning applications to non-destructive defect detection in horticultural products. Biosystems Engineering 189, 60–83. https://doi.org/10.1016/j.biosystemseng.2019.11.011.
Pérez-Pérez, B.D., García Vázquez, J.P., and Salomón-Torres, R., 2021. Evaluation of Convolutional Neural Networks’ Hyperparameters with Transfer Learning to Determine Sorting of Ripe Medjool Dates. Agriculture 11, 115. https://doi.org/10.3390/agriculture11020115.
Qin, X., Zhang, Z., Huang, C., Dehghan, M., Zaiane, O.R., and Jagersand, M., 2020. U$^2$-Net: Going Deeper with Nested U-Structure for Salient Object Detection. Pattern Recognition 106, 107404. https://doi.org/10.1016/j.patcog.2020.107404.
Saeed, A., Abdel-Aziz, A.A., Mossad, A., Abdelhamid, M.A., Alkhaled, A.Y., and Mayhoub, M., 2023. Smart Detection of Tomato Leaf Diseases Using Transfer Learning-Based Convolutional Neural Networks. Agriculture 13, 139. https://doi.org/10.3390/agriculture13010139.
Sarraf, M., Jemni, M., Kahramanoğlu, I., Artés, F., Shahkoomahally, S., Namsi, A., Ihtisham, M., Brestic, M., Mohammadi, M., and Rastogi, A., 2021. Commercial techniques for preserving date palm (Phoenix dactylifera) fruit quality and safety: A review. Saudi Journal of Biological Sciences 28, 4408–4420. https://doi.org/10.1016/j.sjbs.2021.04.035.
Shorten, C., and Khoshgoftaar, T.M., 2019. A survey on Image Data Augmentation for Deep Learning. J Big Data 6, 60. https://doi.org/10.1186/s40537-019-0197-0.
Simonyan, K., and Zisserman, A., 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition.
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z., 2015a. Rethinking the Inception Architecture for Computer Vision.
Szegedy, C., Wei Liu, Yangqing Jia, Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A., 2015b. Going deeper with convolutions, in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Presented at the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Boston, MA, USA, pp. 1–9. https://doi.org/10.1109/CVPR.2015.7298594.
Tran, T.-T., Choi, J.-W., Le, T.-T., and Kim, J.-W., 2019. A Comparative Study of Deep CNN in Forecasting and Classifying the Macronutrient Deficiencies on Development of Tomato Plant. Applied Sciences 9, 1601. https://doi.org/10.3390/app9081601.
Verma, S., Chug, A., and Singh, A.P., 2020. Application of convolutional neural networks for evaluation of disease severity in tomato plant. Journal of Discrete Mathematical Sciences and Cryptography 23, 273–282. https://doi.org/10.1080/09720529.2020.1721890.
Wang, C., Liu, B., Liu, L., Zhu, Y., Hou, J., Liu, P., and Li, X., 2021. A review of deep learning used in the hyperspectral image analysis for agriculture. Artif Intell Rev 54, 5205–5253. https://doi.org/10.1007/s10462-021-10018-y.
Yang, L., Wang, S.-H., and Zhang, Y.-D., 2022. EDNC: Ensemble Deep Neural Network for COVID-19 Recognition. Tomography 8, 869–890. https://doi.org/10.3390/tomography8020071.
Yu, F., Lu, T., and Xue, C., 2023. Deep Learning-Based Intelligent Apple Variety Classification System and Model Interpretability Analysis. Foods 12, 885. https://doi.org/10.3390/foods12040885.

Files

Share

How to cite

Statistics