Interval fuzzy rough feature selection under simulated missingness and training label noise
Downloads
Abstract
Feature selection on incomplete tables requires a criterion whose uncertainty representation is distinguished from the preprocessing used in its evaluation. We formulate an interval fuzzy-rough framework based on admissible completions and examine a simpler implementation, Interval Type-2 Fuzzy-Rough Feature Selection (IT2-FRFS), using interval Gaussian similarity scales after mean imputation. Reported experiments cover breast cancer, wine, an 800-row digits subsample, and an 800-by-20 synthetic table under 15% Missing Completely at Random (MCAR) and 10% label noise in downstream training folds, with ten corruption seeds. Selection uses clean labels. The tested midpoint-gain search reaches its feature cap on every dataset, selecting all features on wine and the synthetic table. Mean k-nearest-neighbour accuracy is 0.8738, compared with 0.8964 for minimum Redundancy Maximum Relevance (mRMR) and 0.9093 for ReliefF. A fixed-width ablation on two datasets produces small accuracy differences, without establishing an advantage of interval scales. Logistic regression improves relative to all features on breast cancer and digits, but mRMR remains stronger. The results characterize this capped, mean-imputed implementation; they do not evaluate selection from noisy labels, completion envelopes, adaptive interval widths, or missing-at-random and missing-not-at-random mechanisms. Reported pooled significance tests require reconsideration of seed dependence and validation nesting before they support general inference.
Keywords
Interval type-2 fuzzy sets Fuzzy-rough feature selection Missing data mechanisms Label noise Selection stability Robust data scienceReferences (24)
- [1] Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of machine learning research, 3(3), 1157–1182. https://dl.acm.org/doi/pdf/10.5555/944919.944968
- [2] Kuncheva, L. I. (2007). A stability index for feature selection. Artificial intelligence and applications (pp. 390–395). ACTA Press. https://lucykuncheva.co.uk/papers/lkAIA07.pdf
- [3] Rubin, D. B. (1976). Inference and missing data. Biometrika, 63(3), 581–592. https://doi.org/10.1093/biomet/63.3.581
- [4] Frénay, B., & Verleysen, M. (2013). Classification in the presence of label noise: A survey. IEEE transactions on neural networks and learning systems, 25(5), 845–869. https://doi.org/10.1109/TNNLS.2013.2292894
- [5] Pawlak, Z. (1982). Rough sets. International journal of computer & information sciences, 11(5), 341–356. https://doi.org/10.1007/BF01001956
- [6] Dubois, D., & Prade, H. (1990). Rough fuzzy sets and fuzzy rough sets. International journal of general system, 17(2–3), 191–209. https://doi.org/10.1080/03081079008935107
- [7] Jensen, R., & Shen, Q. (2004). Semantics-preserving dimensionality reduction: Rough and fuzzy-rough-based approaches. IEEE transactions on knowledge and data engineering, 16(12), 1457–1471. https://doi.org/10.1109/TKDE.2004.96
- [8] Mendel, J. M., & John, R. I. B. (2002). Type-2 fuzzy sets made simple. IEEE transactions on fuzzy systems, 10(2), 117–127. https://doi.org/10.1109/91.995115
- [9] Zadeh, L. A. (1965). Fuzzy sets. Information and control, 8(3), 338–353. https://doi.org/10.1016/S0019-9958(65)90241-X
- [10] Jensen, R., & Shen, Q. (2009). Interval-valued fuzzy-rough feature selection in datasets with missing values. 2009 IEEE international conference on fuzzy systems (pp. 610–615). IEEE. https://doi.org/10.1109/FUZZY.2009.5277289
- [11] Maji, P., & Garai, P. (2014). IT2 fuzzy-rough sets and max relevance-max significance criterion for attribute selection. IEEE transactions on cybernetics, 45(8), 1657–1668. https://doi.org/10.1109/TCYB.2014.2357892
- [12] Little, R. J. A., & Rubin, D. B. (2019). Statistical analysis with missing data. John Wiley & Sons. https://doi.org/10.1002/9781119482260
- [13] Peng, H., Long, F., & Ding, C. (2005). Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE transactions on pattern analysis and machine intelligence, 27(8), 1226–1238. https://doi.org/10.1109/TPAMI.2005.159
- [14] Jensen, R., & Shen, Q. (2008). New approaches to fuzzy-rough feature selection. IEEE transactions on fuzzy systems, 17(4), 824–838. https://doi.org/10.1109/TFUZZ.2008.924209
- [15] Kryszkiewicz, M. (1998). Rough set approach to incomplete information systems. Information sciences, 112(1–4), 39–49. https://doi.org/10.1016/S0020-0255(98)10019-1
- [16] Van Buuren, S. (2018). Flexible imputation of missing data. Chapman and hall/CRC. https://doi.org/10.1201/9780429492259
- [17] Van Buuren, S., & Groothuis-Oudshoorn, K. (2011). MICE: Multivariate imputation by chained equations in R. Journal of statistical software, 45(3), 1–67. https://doi.org/10.18637/jss.v045.i03
- [18] Angluin, D., & Laird, P. (1988). Learning from noisy examples. Machine learning, 2(4), 343–370. https://doi.org/10.1007/BF00116829
- [19] Natarajan, N., Dhillon, I. S., Ravikumar, P. K., & Tewari, A. (2013). Learning with noisy labels. Advances in neural information processing systems (pp. 1196–1204). Curran Associates, Inc. https://papers.nips.cc/paper/5073-learning-with-noisy-labels
- [20] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., ...& Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of machine learning research, 12, 2825–2830. https://jmlr.org/papers/v12/pedregosa11a.html
- [21] Kononenko, I. (1994). Estimating attributes: Analysis and extensions of relief. European conference on machine learning (pp. 171–182). Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-57868-4_57
- [22] Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics bulletin, 1(6), 80–83. https://doi.org/10.2307/3001968
- [23] Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of machine learning research, 7(1), 1–30. https://jmlr.org/papers/v7/demsar06a.html
- [24] Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics, 7(2), 65–70. https://www.jstor.org/stable/4615733