English abstract
Detection of early stages of microbial infection on dates in processing and handling facilities by the present manual sorting method is not accurate. Fungal infection in date fruits causes possible mycotoxin production. Therefore, it is crucial to develop and implement a fast, non-destructive, objective, accurate and real-time technique to detect fungal infection in date handling facilities. The potential of three computer vision techniques such as Near infrared hyperspectral imaging (NIR-HSI), Near infrared (NIR) areascan imaging and RGB color imaging to detect A. flavus infection on dates in Oman was investigated. Several algorithms were developed and analyzed to detect and classify fungal infection. Also, the scope for methodology and implementation of the developed techniques on commercial aspect were investigated.
Three popular date varieties (Fard, Khalas and Naghal) were used for this study. The samples were treated as three groups; untreated control (UC), sterile control (SC-surface sterilized, washed and air-dried) and infected samples (IS-surface sterilized, washed, air-dried and fungus inoculated). Images were taken from infected samples on every alternate day during the incubation period of ten days. After pre-processing and image segmentation, significant features were extracted from the date images and applied to the statistical classifiers (linear discriminant analysis (LDA) and quadratic discriminant analysis (QDA)). Also classification was carried out with only the top five most contributing features using stepwise linear discriminant analysis (SLDA) and stepwise quadratic discriminant analysis (SQDA). Two-class models (control vs. infected dates), six-class models (control, IS Day 2, IS Day 4, IS Day 6, IS Day 8 and IS Day 10) and pair-wise models (control vs. each stage of infection) were developed.
Hyperspectral images of control and infested samples were acquired from 75 image slices at 10 nm intervals between 960 and 1700 nm. A total of 64 features were extracted from the top four most significant wavelengths (1120 nm, 1300 nm, 1610 nm and 1650 nm), having 10 histogram features and 6 statistical features at 4 wavelengths. The iS of Khalas dates obtained average accuracies of 100%, 92% and 100% for two-class, six-class and pair-wise models, respectively. In general, QDA obtained better accuracy than LDA in all the classification models tested. Further work is required to test the efficiency of this technique for other date fruit varieties.
BCV
The near infrared area-scan imaging acquired a single image from 900 to 1700 nm. A total of 55 features (11 histogram features, 36 histogram groups and 8 texture features) were extracted from 3,150 images of dates. The overall highest classification accuracy for IS was 97% 96% and 100% for two-class, six-class and pair-wise models, respectively. The developed algorithm was tested on pooled dates (all three varieties combined) and 86% of IS were correctly classified. LDA obtained better classification accuracy than QDA.
In RGB color imaging, 16 features (11 histogram features and 5 textural features) from red, green, blue and grey components (total: 16x4=64 features) were extracted from RGB color images and applied to the statistical classification models. In two-class model, the highest accuracy obtained by Fard, Khalas and Naghal dates were 97%, 100% and 99%, respectively. In pooled dates, 99% of IS were correctly classified from control. In general, using reduced features by SLDA and SQDA, the classification accuracies obtained were less than LDA and QDA in most of the tested models.
All three imaging techniques developed in this study were effective for early detection of A. flavus on date fruits even before developing any visible symptoms. However, RGB color imaging can be effectively used as the least expensive and convenient imaging system to detect and classify fungus infected date fruits from healthy dates. Further studies are required to investigate the effect of moisture content, hardness, maturity stages and skin delamination of date fruits in the discrimination of healthy and fungus infected samples. The effectiveness of the developed algorithms should also be tested for other species of fungus infection in dates.