Loading [MathJax]/extensions/MathMenu.js
An Interpretable Fuzzy Classifier Learned Through Soft-Margin Minimization with Transparent Fuzzy Sets | IEEE Conference Publication | IEEE Xplore

An Interpretable Fuzzy Classifier Learned Through Soft-Margin Minimization with Transparent Fuzzy Sets


Abstract:

This paper proposes an interpretable fuzzy classifier learned through soft-margin minimization (IFC-SMM) with the consideration of fuzzy set transparency. The rules of th...Show More

Abstract:

This paper proposes an interpretable fuzzy classifier learned through soft-margin minimization (IFC-SMM) with the consideration of fuzzy set transparency. The rules of the IFC-SMM are built through a firing-strength-based clustering method. Parameters in the IFC-SMM are learned through SMM to endow the fuzzy classifier (FC) with high generalization ability. Based on the SMM, the antecedent and consequent parameters in the built rules are learned through the gradient descent algorithm and support vector machine (SVM), respectively. To improve the interpretability of the IFC-SMM, two constraints imposed on fuzzy set transparency are introduced into the SMM in the tuning of the antecedent parameters. Experimental results on real classification problems with comparisons with different FCs show the characteristics of the IFC-SMM.
Date of Conference: 30 June 2024 - 05 July 2024
Date Added to IEEE Xplore: 05 August 2024
ISBN Information:

ISSN Information:

Conference Location: Yokohama, Japan
References is not available for this document.

I. Introduction

Fuzzy classifiers (FCs) that comprise fuzzy if-then rules have been extensively applied to different classification problems, ranging from image classification [1], [2] to medical diagnosis [3]–[5]. To automate the design of FCs, many data-driven learning approaches have been proposed. Among the various alternative learning approaches, a popular one is neural FCs that optimize fuzzy rules through neural learning [4], [6]–[9]. Another popular approach is evolutionary FCs that optimize fuzzy rules through evolutionary computation techniques, such as genetic algorithms [1], [10]–[13]. These approaches optimize fuzzy rules by minimizing an objective function typically defined as the classification error of training patterns. Minimization of training error does not imply good test performance and may face the overtraining problem. Therefore, the test performance of neural and evolutionary FCs may be unsatisfactory.

Select All
1.
A. M. Anter, G. Huang, L. Li, L. Zhang, Z. Liang and Z. Zhang, "A new type of fuzzy-rule-based system with chaotic swarm intelligence for multiclassification of pain perception from fMRI" in IEEE Trans. Fuzzy Syst, vol. 28, no. 6, pp. 1096-1109, June 2020.
2.
S. Kamthan, H. Singh and T. Meitzler, "Hierarchical fuzzy deep learning for image classification", Memories - Materials Devices Circuits and Systems, vol. 2, pp. 1-13, 2022.
3.
T. Nguyen and S. Nahavandi, "Modified AHP for gene selection and cancer classification using type-2 fuzzy logic", IEEE Trans. Fuzzy Syst, vol. 24, no. 2, pp. 273-287, 2016.
4.
M. F. Wu, W. C. Huang, C. F. Juang, K. M. Chang, C. Y. Wen, Y. H. Chen, et al., "A new method for self-estimation of the severity of obstructive sleep apnea using easily available measurements and neural fuzzy evaluation system", IEEE Journal of Biomedical and Health Informatics, vol. 21, no. 6, pp. 1524-1532, Nov. 2017.
5.
K. Sarin, M. Bardamova, M. Svetlakov, N. Koryshev, R. Ostapenko, A. Hodashinskaya, et al., "A three-stage fuzzy classifier method for Parkinson's disease diagnosis using dynamic handwriting analysis", Decision Analytics Journal, vol. 8, pp. 1-23, 2023.
6.
N. Talpur, S. J. Abdulkadir and M. H. Hasan, "A deep learning based neuro-fuzzy approach for solving classification problems", Proc. Int. Conf. Computational Intelligence Virtual Conf., pp. 1-6, Oct. 2020.
7.
J. Zhao, Y. Liu, L. Wang and W. Wang, "A generalized heterogeneous type-2 fuzzy classifier and its industrial application", IEEE Trans. Fuzzy Syst, vol. 28, no. 10, pp. 2287-2301, Oct. 2020.
8.
M. Yeganejou, R. Kluzinski, S. Dick and J. Miller, "An end-to-end trainable deep convolutional neuro-fuzzy classifier", Proc. IEEE Int. Conf. Fuzzy Syst, pp. 1-7, July 2022.
9.
C. F. Juang, Y. W. Cheng and Y. M. Lin, "Visually interpretable fuzzy neural classification network with deep convolutional feature maps", IEEE Trans. Fuzzy Syst, vol. 32, no. 3, pp. 1063-1077, March 2024.
10.
E.G. Mansoori, M.J. Zolghadri, S.D. Katebi and D. Sger, "A steady-state genetic algorithm for extracting fuzzy classification rules from data", IEEE Trans. Fuzzy Syst, vol. 16, no. 4, pp. 1061-1071, 2008.
11.
A. Orriols-Puig, J. Casillas and E. Bernadó-Mansilla, "Genetic-based machine learning systems are competitive for pattern recognition", Evol. Intel, vol. 1, pp. 209-232, 2008.
12.
O. Gordo, E. Martinez, C. Gonzalo and A. Arquero, "Classification of satellite images by means of fuzzy rules generated by a genetic algorithm", IEEE Latin America Trans, vol. 9, no. 1, pp. 743-748.
13.
C. F. Juang, G. R. Pan, W. C. Huang, C. Y. Wen and M. F. Wu, "Multiobjective optimization of interpretable fuzzy systems and applicable subjects for fast estimation of obstructive sleep apnea-hypopnea severity", IEEE Trans. Fuzzy Syst, vol. 31, no. 7, pp. 2225-2237, July 2023.
14.
N. Cristianini and J. S. Taylor, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, Cambridge U.K.:Cambridge Univ. Press, 2000.
15.
A. Kumar et al., "CoMHisP: A novel feature extractor for histopathological image classification based on fuzzy SVM with within-class relative density", IEEE Tran. Fuzzy Syst, vol. 29, no. 1, pp. 103-117, 2021.
16.
Y. Chen, Q. Mao, B. Wang, P. Duan, B. Zhang and Z. Hong, "Privacy-preserving multiclass support vector machine model on medical diagnosis", IEEE J. Biomedical and Health Informatics, vol. 26, no. 7, pp. 3342-3353, July 2022.
17.
Y. Chen and J. Z. Wang, "Support vector learning for fuzzy rule-based classification systems", IEEE Trans. Fuzzy Syst, vol. 11, no. 6, pp. 716-728, Dec. 2003.
18.
C. T. Lin, C. M. Yeh, S. F. Liang, J. F. Chung and N. Kumar, "Support-vector-based fuzzy neural network for pattern classification", IEEE Trans. Fuzzy Syst, vol. 14, no. 1, pp. 31-41, Feb. 2006.
19.
C. F. Juang, S. H. Chiu and S. J. Shiu, "Fuzzy system learned through fuzzy clustering and support vector machine for human skin color segmentation", IEEE Trans. Syst. Man and Cyber. Part A: Systems and Humans, vol. 37, no. 6, pp. 1077-1087, Nov. 2007.
20.
S. M. Zhou and J. Q. Gan, "Constructing L2-SVM-based fuzzy classifiers in high-dimensional space with automatic model selection and fuzzy rule ranking", IEEE Trans. Fuzzy Syst, vol. 15, no. 3, pp. 398-409, June 2007.
21.
C. F. Juang, S. H. Chiu and S. W. Chang, "A self-organizing TS-type fuzzy network with support vector learning and its application to classification problems", IEEE Trans. Fuzzy Syst, vol. 15, no. 5, pp. 998-1008, Oct. 2007.
22.
C. F. Juang and S. J. Shiu, "Using self-organizing fuzzy network with support vector learning for face detection in color images", Neurocomputing, vol. 71, pp. 16-18, Oct. 2008.
23.
W. Y. Cheng and C. F. Juang, "An incremental support vector machine-trained TS-type fuzzy system for online classification problems", Fuzzy Sets and Syst, vol. 163, no. 1, pp. 24-44, Jan. 2011.
24.
W. Y. Cheng and C. F. Juang, "A fuzzy model with online incremental SVM and margin-selective gradient descent learning for classification problems", IEEE Trans. Fuzzy Syst, vol. 22, no. 2, pp. 324-337, April 2014.
25.
C. F. Juang and P. H. Wang, "An interval type-2 neural fuzzy classifier learned through soft margin minimization and its human posture classification application", IEEE Trans. Fuzzy Syst, vol. 23, no. 5, pp. 1474-1487, Oct. 2015.
26.
C. F. Juang and W. E. Ni, "Human posture classification using interpretable 3-D fuzzy body voxel features and hierarchical fuzzy classifiers", IEEE Trans. Fuzzy Syst, vol. 30, no. 12, pp. 5405-5418, Dec. 2022.
27.
A. B. Arrieta et al., "Explainable artificial intelligence (XAI): Concepts taxonomies opportunities and challenges toward responsible AI", Inf. Fusion, vol. 58, pp. 82-115, Jun. 2020.
28.
W. J. Murdoch, C. Singh, K. Kumbier, R. Abbasi-Asl and B. Yu, "Definitions methods and applications in interpretable machine learning", Proc. Nat. Acad. Sci. USA, vol. 116, no. 44, pp. 22071-22080, Oct. 2019.
29.
J. Casillas, O. Cordon, F. Herrera and L. Magdalena, Interpretability Issues in Fuzzy Modeling, Berlin Heidelberg:Springer Verlag, 2003.
30.
C. F. Juang and C. Y. Chen, "Data-driven interval type-2 neural fuzzy system with high learning accuracy and improved model interpretability", IEEE Trans. Cybernetics, vol. 43, no. 6, pp. 1781-1795, Dec. 2013.

Contact IEEE to Subscribe

References

References is not available for this document.