Efficient Learning From Two-Class Categorical Imbalanced Healthcare Data

Efficient Learning From Two-Class Categorical Imbalanced Healthcare Data

Lincy Mathews, Hari Seetha
DOI: 10.4018/IJHISI.2021010105
Article PDF Download
Open access articles are freely available for download

Abstract

When data classes are differently represented in one v. other data segment to be mined, it generates the imbalanced two-class data challenge. Many health-related datasets comprising categorical data are faced with the class imbalance challenge. This paper aims to address the limitations of imbalanced two-class categorical data and presents a re-sampling solution known as ‘Syn_Gen_Min' (SGM) to improve the class imbalance ratio. SGM involves finding the greedy neighbors for a given minority sample. To the best of one's knowledge, the accepted approach for a classifier is to find the numeric equivalence for categorical attributes, resulting in the loss of information. The novelty of this contribution is that the categorical attributes are kept in their raw form. Five distinct categorical similarity measures are employed and tested against six real-world datasets derived within the healthcare sector. The application of these similarity methods leads to the generation of different synthetic samples, which has significantly improved the performance measures of the classifier. This work further proves that there is no generic similarity measure that fits all datasets.
Article Preview
Top

2. Background

Among key factors affecting the analysis of imbalanced datasets via traditional and/or canonical algorithms, three stand out, namely, accuracy, class distribution and error costs. Real-world datasets display skewed distribution. Effectively, accuracy should reflect the misclassification of the minority class. The error cost for misclassifying rare classes is much higher with the use of traditional algorithms. Other factors such as complexity, disjuncts, overlapping and size of training sets also play a role (Batista & Prati, 2004).

Complete Article List

Search this Journal:
Reset
Volume 19: 1 Issue (2024)
Volume 18: 1 Issue (2023)
Volume 17: 2 Issues (2022)
Volume 16: 4 Issues (2021)
Volume 15: 4 Issues (2020)
Volume 14: 4 Issues (2019)
Volume 13: 4 Issues (2018)
Volume 12: 4 Issues (2017)
Volume 11: 4 Issues (2016)
Volume 10: 4 Issues (2015)
Volume 9: 4 Issues (2014)
Volume 8: 4 Issues (2013)
Volume 7: 4 Issues (2012)
Volume 6: 4 Issues (2011)
Volume 5: 4 Issues (2010)
Volume 4: 4 Issues (2009)
Volume 3: 4 Issues (2008)
Volume 2: 4 Issues (2007)
Volume 1: 4 Issues (2006)
View Complete Journal Contents Listing