×

GLRM: logical pattern mining in the case of inconsistent data distribution based on multigranulation strategy. (English) Zbl 07478966

Summary: Recently, many learning-based methods have explored logic learning task in the assumption that the training set and testing set are from the consistent distribution, achieving good performance. But, in most cases, this assumption does not hold. In this paper, we explore this topic on the open-set logic reasoning task where the digit length and the sequence length of the training set and testing set are from inconsistent distributions. To address this issue, inspired by multigranulation studies in granular computing, we propose a granulation logic reasoning machine, namely GLRM. In this method, this open-set task is granulated into a series of sub-tasks from two dimensions: the digit length and the sequence length, and then these sub-tasks are conquered one by one. Finally, the results of the sub-tasks are organized into the final result. The effectiveness of GLRM is demonstrated by experiments on the open-set Fashion-Logic data set and the open-set Fashion-Logic task proposed in this paper. This study provides a novel view for solving open-set logic reasoning tasks and promotes the research of data-driven logic learning.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
68T37 Reasoning under uncertainty in the context of artificial intelligence
Full Text: DOI

References:

[1] Mousavi, S. M.; Abdullah, S.; Niaki, S. T.A.; Banihashemi, S., An intelligent hybrid classification algorithm integrating fuzzy rule-based extraction and harmony search optimization: medical diagnosis applications, Knowl.-Based Syst., 220, Article 106943 pp. (2021)
[2] Jiang, H.; Zhan, J.; Sun, B.; Alcantud, J. C.R., An madm approach to covering-based variable precision fuzzy rough sets: an application to medical diagnosis, Int. J. Mach. Learn. Cybern., 11, 9, 2181-2207 (2020)
[3] Sun, B.; Zhou, X.; Lin, N., Diversified binary relation-based fuzzy multigranulation rough set over two universes and application to multiple attribute group decision making, Inf. Fusion, 55, 91-104 (2020)
[4] Shang, R.; Song, J.; Jiao, L.; Li, Y., Double feature selection algorithm based on low-rank sparse non-negative matrix factorization, Int. J. Mach. Learn. Cybern., 1-18 (2020)
[5] Javidi, M. M., Feature selection schema based on game theory and biology migration algorithm for regression problems, Int. J. Mach. Learn. Cybern., 12, 2, 303-342 (2021)
[6] Wang, C.; Hu, Q.; Wang, X.; Chen, D.; Qian, Y.; Dong, Z., Feature selection based on neighborhood discrimination index, IEEE Trans. Neural Netw. Learn. Syst., 29, 7, 2986-2999 (2017)
[7] Liang, X.; Guo, Q.; Qian, Y.; Ding, W.; Zhang, Q., Evolutionary deep fusion method and its application in chemical structure recognition, IEEE Trans. Evol. Comput., 25, 5, 883-893 (2021)
[8] Liang, X.; Qian, Y.; Guo, Q.; Cheng, H.; Liang, J., AF: an association-based fusion method for multi-modal classification, IEEE Trans. Pattern Anal. Mach. Intell. (2021)
[9] Li, J.; Huang, C.; Qi, J.; Qian, Y.; Liu, W., Three-way cognitive concept learning via multi-granularity, Inf. Sci., 378, 1, 244-263 (2017) · Zbl 1429.68228
[10] Yang, X.; Liang, S.; Yu, H.; Gao, S.; Qian, Y., Pseudo-label neighborhood rough set: measures and attribute reductions, Int. J. Approx. Reason., 105, 112-129 (2019) · Zbl 1452.68236
[11] Yao, Y., Three-way granular computing, rough sets, and formal concept analysis, Int. J. Approx. Reason., 116, 106-125 (2020) · Zbl 1468.68246
[12] Zhang, Q.; Chen, Y.; Yang, J.; Wang, G., Fuzzy entropy: a more comprehensible perspective for interval shadowed sets of fuzzy sets, IEEE Trans. Fuzzy Syst., 28, 11, 3008-3022 (2019)
[13] Guo, Y.; Tsang, E. C.; Xu, W.; Chen, D., Local logical disjunction double-quantitative rough sets, Inf. Sci., 500, 87-112 (2019) · Zbl 1451.68280
[14] Hu, Q.; Zhang, L.; An, S.; Zhang, D.; Yu, D., On robust fuzzy rough set models, IEEE Trans. Fuzzy Syst., 20, 4, 636-651 (2011)
[15] Zhang, P.; Li, T.; Wang, G.; Luo, C.; Chen, H.; Zhang, J.; Wang, D.; Yu, Z., Multi-source information fusion based on rough set theory: a review, Inf. Fusion, 68, 85-117 (2021)
[16] She, Y.; He, X.; Shi, H.; Qian, Y., A multiple-valued logic approach for multigranulation rough set model, Int. J. Approx. Reason., 82, 270-284 (2017) · Zbl 1404.68174
[17] Wu, W.; Qian, Y.; Li, T.; Gu, S., On rule acquisition in incomplete multi-scale decision tables, Inf. Sci., 378, 282-302 (2017) · Zbl 1429.68300
[18] Qian, Y.; Li, Y.; Liang, J.; Lin, G.; Dang, C., Fuzzy granular structure distance, IEEE Trans. Fuzzy Syst., 23, 6, 2245-2259 (2015)
[19] Yan, R.; Yu, Y.; Qiu, D., Emotion-enhanced classification based on fuzzy reasoning, Int. J. Mach. Learn. Cybern., 1-12 (2021)
[20] Xu, W.; Wang, Q.; Zhang, X., Multi-granulation fuzzy rough sets in a fuzzy tolerance approximation space, Int. J. Fuzzy Syst., 13, 4, 246-259 (2011)
[21] Lin, G.; Liang, J.; Qian, Y., An information fusion approach by combining multigranulation rough sets and evidence theory, Inf. Sci., 314, 184-199 (2015) · Zbl 1387.68217
[22] Pearl, J., Evidential reasoning using stochastic simulation of causal models, Artif. Intell., 32, 2, 245-257 (1987) · Zbl 0642.68177
[23] Tan, A.; Wu, W.-Z.; Tao, Y., A unified framework for characterizing rough sets with evidence theory in various approximation spaces, Inf. Sci., 454, 144-160 (2018) · Zbl 1440.68300
[24] Sun, B.; Ma, W.; Li, B.; Li, X., Three-way decisions approach to multiple attribute group decision making with linguistic information-based decision-theoretic rough fuzzy set, Int. J. Approx. Reason., 93, 424-442 (2018) · Zbl 1452.68228
[25] Yao, Y., Probabilistic rough set approximations, Int. J. Approx. Reason., 49, 2, 255-271 (2008) · Zbl 1191.68702
[26] Yao, Y., Three-way decisions with probabilistic rough sets, Inf. Sci., 180, 3, 341-353 (2010)
[27] She, Y.; He, X.; Qian, Y.; Xu, W.; Li, J., A quantitative approach to reasoning about incomplete knowledge, Inf. Sci., 451, 100-111 (2018) · Zbl 1440.68277
[28] Tenenbaum, J.; Griffiths, T.; Kemp, C., Theory-based Bayesian models of inductive learning and reasoning, Trends Cogn. Sci., 10, 7, 309-318 (2006)
[29] Yang, Z.; Bonsall, S.; Wang, J., Fuzzy rule-based Bayesian reasoning approach for prioritization of failures in fmea, IEEE Trans. Reliab., 57, 3, 517-528 (2008)
[30] Guo, Q.; Qian, Y.; Liang, X., Mining logic patterns from visual data, (International Conference on Data Mining Workshops (2019)), 620-627
[31] Guo, Q.; Qian, Y.; Liang, X.; She, Y.; Li, D.; Liang, J., Logic could be learned from images, Int. J. Mach. Learn. Cybern., 12, 12, 3397-3414 (2021)
[32] Guo, Q.; Qian, Y.; Liang, X.; Chen, J.; Cheng, H., Multi-granulation multi-scale relation network for abstract reasoning, Int. J. Mach. Learn. Cybern. (2022)
[33] Lake, B. M.; Salakhutdinov, R.; Tenenbaum, J. B., Human-level concept learning through probabilistic program induction, Science, 350, 6266, 1332-1338 (2015) · Zbl 1355.68230
[34] Segler, M.; Waller, M., Neural symbolic machine learning for retrosynthesis and reaction prediction, Chemistry, 23, 25, 5966-5971 (2017)
[35] Donadello, I.; Serafini, L.; Garcez, A., Logic tensor networks for semantic image interpretation, (Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17 (2017)), 1596-1602
[36] Tran, S. N.; Garcez, A. S.d., Deep logic networks: inserting and extracting knowledge from deep belief networks, IEEE Trans. Neural Netw. Learn. Syst., 29, 2, 246-258 (2016)
[37] Hoshen, Y.; Peleg, S., Visual learning of arithmetic operation, (Association for the Advancement of Artificial Intelligence. Association for the Advancement of Artificial Intelligence, Phoenix, USA (2016)), 3733-3739
[38] Hu, Q.; Yu, D.; Liu, J.; Wu, C., Neighborhood rough set based heterogeneous feature subset selection, Inf. Sci., 178, 18, 3577-3594 (2008) · Zbl 1154.68466
[39] Qian, Y.; Cheng, H.; Wang, J.; Liang, J.; Pedrycz, W.; Dang, C., Grouping granular structures in human granulation intelligence, Inf. Sci., 382, 150-169 (2017)
[40] Wang, C.; Huang, Y.; Ding, W.; Cao, Z., Attribute reduction with fuzzy rough self-information measures, Inf. Sci., 549, 68-86 (2021) · Zbl 1474.68367
[41] Zadeh, L., Some reflections on soft computing, granular computing and their roles in the conception, design and utilization of information/intelligent systems, Soft Comput., 2, 1, 23-25 (1998)
[42] Lin, T. Y., Granular computing on binary relations ii: rough set representations and belief functions, (Rough Sets in Knowledge Discovery, vol. 1 (1998)), 122-140 · Zbl 0927.68090
[43] Zadeh, L., Fuzzy logic equals computing with words, IEEE Trans. Fuzzy Syst., 4, 2, 103-111 (1996)
[44] Zadeh, L. A., Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic, Fuzzy Sets Syst., 90, 90, 111-127 (1997) · Zbl 0988.03040
[45] Yager, R. R.; Filev, D. P., Fuzzy rule based models and approximate reasoning, (Fuzzy Systems (1998), Springer), 91-133 · Zbl 0923.93034
[46] Qian, J.; Liu, C.; Miao, D.; Yue, X., Sequential three-way decisions via multi-granularity, Inf. Sci., 507, 606-629 (2020) · Zbl 1456.68199
[47] Qian, Y.; Liang, J.; Pedrycz, W.; Dang, C., Positive approximation: an accelerator for attribute reduction in rough set theory, Artif. Intell., 174, 9-10, 597-618 (2010) · Zbl 1205.68310
[48] Yao, Y.; She, Y., Rough set models in multigranulation spaces, Inf. Sci., 327, 40-56 (2016) · Zbl 1390.68685
[49] Zhang, P.; Li, T.; Yuan, Z.; Chuan, L.; Wang, G.; Liu, J.; Du, S., A data-level fusion model for unsupervised attribute selection in multi-source homogeneous data, Inf. Fusion, 80, 87-103 (2022)
[50] Zhang, P.; Li, T.; Luo, C.; Wang, G., Amg-dtrs: adaptive multi-granulation decision-theoretic rough sets, Int. J. Approx. Reason., 140, 7-30 (2022) · Zbl 07460568
[51] Qian, Y.; Liang, J.; Yao, Y.; Dang, C., MGRS: a multi-granulation rough set, Inf. Sci., 180, 6, 949-970 (2010) · Zbl 1185.68695
[52] Qian, Y.; Liang, X.; Lin, G.; Guo, Q.; Liang, J., Local multigranulation decision-theoretic rough sets, Int. J. Approx. Reason., 82, 119-137 (2017) · Zbl 1404.68172
[53] Xiao, H.; Rasul, K.; Vollgraf, R., Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms, CoRR
[54] Zhou, Z.-H., Abductive learning: towards bridging machine learning and logical reasoning, Sci. China Inf. Sci., 62, 7, 1-3 (2019)
[55] Dai, W.; Xu, Q.; Yu, Y.; Zhou, Z., Bridging machine learning and logical reasoning by abductive learning, (Proceedings of the 33rd International Conference on Neural Information Processing Systems (2019)), 2815-2826
[56] Manhaeve, R.; Dumancic, S.; Kimmig, A.; Demeester, T.; De Raedt, L., Deepproblog: neural probabilistic logic programming, (Advances in Neural Information Processing Systems, vol. 31 (2018)), 3749-3759
[57] Gaunt, A.; Brockschmidt, M.; Kushman, N.; Tarlow, D., Differentiable programs with neural libraries, (Proceedings of the 34th International Conference on Machine Learning (2017)), 1213-1222
[58] Li, H.; Zhang, L.; Huang, B.; Zhou, X., Sequential three-way decision and granulation for cost-sensitive face recognition, Knowl.-Based Syst., 91, 241-251 (2016)
[59] Qian, Y.; Li, F.; Liang, J.; Liu, B.; Dang, C., Space structure and clustering of categorical data, IEEE Trans. Neural Netw. Learn. Syst., 27, 10, 2047-2059 (2015)
[60] Yao, Y., Three-way decision and granular computing, Int. J. Approx. Reason., 103, 107-123 (2018) · Zbl 1448.68427
[61] Ding, W.; Wang, J.; Wang, J., Multigranulation consensus fuzzy-rough based attribute reduction, Knowl.-Based Syst., 198, Article 105945 pp. (2020)
[62] Huang, B.; Guo, C. xiang; Zhuang, Y. liang; Li, H. xiong; Zhou, X. zhong, Intuitionistic fuzzy multigranulation rough sets, Inf. Sci., 277, 299-320 (2014) · Zbl 1354.03076
[63] Lin, G.; Liang, J.; Qian, Y., Multigranulation rough sets: from partition to covering, Inf. Sci., 241, 101-118 (2013) · Zbl 1320.68191
[64] Xu, W.; Guo, Y., Generalized multigranulation double-quantitative decision-theoretic rough set, Knowl.-Based Syst., 105, 190-205 (2016)
[65] Yang, X.; Song, X.; Chen, Z.; Yang, J., On multigranulation rough sets in incomplete information system, Int. J. Mach. Learn. Cybern., 3, 3, 223-232 (2012)
[66] Eiben, Á. E.; Hinterding, R.; Michalewicz, Z., Parameter control in evolutionary algorithms, IEEE Trans. Evol. Comput., 3, 2, 124-141 (1999)
[67] Graves, A., Long short-term memory, Neural Comput., 9, 8, 1735-1780 (1997)
[68] Hinton, G.; Salakhutdinov, R., Reducing the dimensionality of data with neural networks, Science, 313, 5786, 504-507 (2006) · Zbl 1226.68083
[69] He, K.; Zhang, X.; Ren, S.; Sun, J., Deep residual learning for image recognition, (Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)), 770-778
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.