XGBOrdinal: An XGBoost Extension for Ordinal Data.
Journal:
Studies in health technology and informatics
Published Date:
May 15, 2025
Abstract
We propose XGBOrdinal, an extension of XGBoost designed for ordinal classification problems commonly found in fields like medicine, where outcomes are often represented as scores, scales, stages, or grades. The proposed approach builds on the theoretical method introduced by Frank and Hall (2001) to transform an ordinal classification problem into a series of binary classification problems. Evaluated on multiple datasets, XGBOrdinal outperformed XGBClassifier and XGBRegressor, as well as existing ordinal methods. The implementation is fully compatible with GridSearchCV and RandomizedSearchCV, making it a scalable and efficient solution for handling ordinal data in machine learning pipelines. The used code is available open source (https://github.com/digital-medicine/XGBOrdinal).
