The demand on high quality palm dates is increasing due to its energy value and nutrient content, which are of great importance in human diet. To meet consumer and market standards with large-scale production, in Oman as among the top date producer, an inline classification system is of great importance. This paper addresses the potentiality of using Machine-Learning (ML) techniques in classifying automatically, without any physical measurement, the six most popular date fruit varieties in Oman. The effect of color, shape, size, and texture features and the critical parameters of the classifiers on the classification efficiency has been endeavored. Three different ML techniques have been used for automatic classification and qualitative comparison: (i) Artificial Neural Networks (ANN), (ii) Support Vector Machine (SVM), and (iii) K-Nearest Neighbor (KNN). Based on the merge of color, shape and size features contributes to achieve the highest accuracy. Experimental results show that the ANN classifier outperforms both SVM and KNN with the highest classification accuracy of 99.2%. This developed vision system in this paper can be successfully integrated in the packaging date factories.