Back to journal

Evaluation on Classifier Performance Across Varied Data Types in Public Datasets Analysis

Sang Vu — Sai Gon University

Nguyen Hoang Thong — Faculty of Information and Technology, Saigon University

Vo Van Tu — Faculty of Information and Technology, Saigon University

Nguyen Duy Tan — Faculty of Information and Technology, Saigon University

Vol. 3No. 1(2024)

Abstract

In the rapidly evolving field of machine learning, the performance of classifiers is often influenced by the nature of the data they are applied to. This manuscript presents a comprehensive evaluation of the performance of various machine learning classifiers—Random Forest (RF), XGBoost (XGB), k-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Artificial Neural Networks (ANN)—across three distinct data types: categorical, mixed, and numerical. Utilizing publicly available datasets and default classifier parameters, the study employs the F1-score as the key performance metric. The findings reveal that ensemble methods like RF and XGB excel in handling both categorical and mixed data types, while XGB stands out for numerical data. On the other hand, classifiers like KNN and SVM face challenges with categorical and mixed data types, respectively. Given that the study was conducted using default parameters, future work should focus on hyperparameter tuning to optimize classifier performance across different data types. This research serves as a valuable resource for machine learning practitioners, offering insights into effective model selection based on data characteristics.

This browser can't display the PDF inline. Open the PDF instead.

2024 Journal of Data Science and Artificial Intelligence