×

Semi-supervised multi-view clustering based on orthonormality-constrained nonnegative matrix factorization. (English) Zbl 1474.68239

Summary: Multi-view clustering aims at integrating the complementary information between different views so as to obtain an accurate clustering result. In addition, the traditional clustering is a kind of unsupervised learning method, which does not take the label information into learning. In this paper, we propose a novel model, called semi-supervised multi-view clustering based on orthonormality-constrained nonnegative matrix factorization (MVOCNMF), to cluster the multi-view data into a number of categories. In the proposed model, based on the label information, we first learn the low-dimensional representations of data by the constrained NMF technique, and simultaneously cluster the samples with the same label into the clustering prototypes for each view. After that, we put forward a novel orthonormality constraint term to obtain the desirable representations for each view, and use the co-regularization to integrate the complementary information from different views. We further develop an alternating minimization algorithm to solve the proposed model, and present the convergence analysis and computational complexity of the proposed method. Extensive experimental results on several multi-view datasets have shown that the proposed MVOCNMF method outperforms the existing multi-view clustering methods.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
15A23 Factorization of matrices
62H30 Classification and discrimination; cluster analysis (statistical aspects)
Full Text: DOI

References:

[1] Kim, E.; Li, H.; Huang, X., A hierarchical image clustering cosegmentation framework, Comput. Vis. Pattern Recogn., 686-693 (2012)
[2] Mammone, N.; Ieracitano, C.; Adeli, H.; Bramanti, A.; Morabito, F. C., Permutation jaccard distance-based hierarchical clustering to estimate eeg network density modifications in mci subjects, IEEE Trans. Neural Networks, 29, 10, 5122-5135 (2018)
[3] Bryant, A. C.; Cios, K. J., Rnn-dbscan: a density-based clustering algorithm using reverse nearest neighbor density estimates, IEEE Trans. Knowl. Data Eng., 30, 6, 1109-1121 (2018)
[4] Zhao, L.; Chen, Z.; Yang, Y.; Zou, L.; Wang, Z. J., Icfs clustering with multiple representatives for large data, IEEE Trans. Neural Networks, 30, 3, 728-738 (2019)
[5] Bhatnagar, V.; Kaur, S.; Chakravarthy, S., Clustering data streams using grid-based synopsis, Knowl. Inf. Syst., 41, 1, 127-152 (2014)
[6] Zhang, J.; Feng, X.; Liu, Z., A grid-based clustering algorithm via load analysis for industrial internet of things, IEEE Access, 6, 13117-13128 (2018)
[7] R.R. Vatsavai, C.T. Symons, V. Chandola, G. Jun, Gx-means: a model-based divide and merge algorithm for geospatial image clustering, International Conference on Conceptual Structures 4 (2011) 186-195.
[8] Slimen, Y. B.; Allio, S.; Jacques, J., Model-based co-clustering for functional data, Neurocomputing, 291, 97-108 (2018)
[9] Buch, A.; Kiforenko, L.; Kraft, D., Rotational subgroup voting and pose clustering for robust 3d object recognition, (International Conference on Computer Vision (2017)), 4137-4145
[10] Boutalbi, R.; Labiod, L.; Nadif, M., Sparse tensor co-clustering as a tool for document categorization, (International ACM Sigir Conference on Research and Development in Information Retrieval (2019)), 1157-1160
[11] Liu, M.; Nie, L.; Wang, X.; Tian, Q.; Chen, B., Online data organizer: Micro-video categorization by structure-guided multimodal dictionary learning, IEEE Trans. Image Process., 28, 3, 1235-1247 (2019)
[12] Redi, M.; Ohare, N.; Schifanella, R.; Trevisiol, M.; Jaimes, A., 6 seconds of sound and vision: creativity in micro-videos, Comput. Vis. Pattern Recogn., 4272-4279 (2014)
[13] Roy, S. D.; Mei, T.; Zeng, W.; Li, S., Towards cross-domain learning for social video popularity prediction, IEEE Trans. Multimedia, 15, 6, 1255-1267 (2013)
[14] Yu, S.; Tranchevent, L. C.; Moor, B. D.; Moreau, Y., Gene prioritization and clustering by multi-view text mining, BMC Bioinf., 11, 1, 28 (2010)
[15] Y. Guo, M. Xiao, Cross language text classification via subspace co-regularized multi-view learning, International Conference on Machine Learning (2012) 915-922.
[16] Liu, J.; Wang, C.; Gao, J.; Han, J., Multi-view clustering via joint nonnegative matrix factorization, SDM, 252-260 (2013)
[17] Ou, W.; Yu, S.; Li, G.; Lu, J.; Zhang, K.; Xie, G., Multi-view non-negative matrix factorization by patch alignment framework with view consistency, Neurocomputing, 204, 116-124 (2016)
[18] Cao, X.; Zhang, C.; Fu, H.; Liu, S.; Zhang, H., Diversity-induced multi-view subspace clustering, Comput. Vis. Pattern Recogn., 586-594 (2015)
[19] Wang, J.; Tian, F.; Yu, H.; Liu, C. H.; Zhan, K.; Wang, X., Diverse non-negative matrix factorization for multiview data representation, IEEE Trans. Cybern., 48, 9, 2620-2632 (2018)
[20] Zhao, L.; Chen, Z.; Wang, Z. J., Unsupervised multiview nonnegative correlated feature learning for data clustering, IEEE Signal Process. Lett., 25, 1, 60-64 (2018)
[21] Liu, H.; Wu, Z.; Li, X.; Cai, D.; Huang, T. S., Constrained nonnegative matrix factorization for image representation, IEEE Trans. Pattern Anal. Mach. Intell., 34, 7, 1299-1311 (2012)
[22] Anand, S.; Mittal, S.; Tuzel, O.; Meer, P., Semi-supervised kernel mean shift clustering, IEEE Trans. Pattern Anal. Mach. Intell., 36, 6, 1201-1215 (2014)
[23] Li, M.; Liu, X.; Wang, L.; Dou, Y.; Yin, J.; Zhu, E., Multiple kernel clustering with local kernel alignment maximization, (International Joint Conference on Artificial Intelligence (2016)), 1704-1710
[24] Liu, X.; Zhou, S.; Wang, Y.; Li, M.; Dou, Y.; Zhu, E.; Yin, J., Optimal neighborhood kernel clustering with multiple kernels, (National Conference on Artificial Intelligence (2017)), 2266-2272
[25] Zhang, R.; Nie, F.; Li, X., Self-weighted spectral clustering with parameter-free constraint, Neurocomputing, 241, 164-170 (2017)
[26] Li, Q.; Ren, Y.; Li, L.; Liu, W., Fuzzy based affinity learning for spectral clustering, Pattern Recogn., 60, 531-542 (2016)
[27] Yang, X.; Yu, W.; Wang, R.; Zhang, G.; Nie, F., Fast spectral clustering learning with hierarchical bipartite graph for large-scale data, Pattern Recogn. Lett., 1-8 (2008)
[28] Elhamifar, E.; Vidal, R., Sparse subspace clustering: Algorithm, theory, and applications, IEEE Trans. Pattern Anal. Mach. Intell., 35, 11, 2765-2781 (2013)
[29] Li, C.; You, C.; Vidal, R., Structured sparse subspace clustering: a joint affinity learning and subspace clustering framework, IEEE Trans. Image Process., 26, 6, 2988-3001 (2017) · Zbl 1409.94342
[30] Cheng, Z.; Shen, J., On effective location-aware music recommendation, ACM Trans. Inf. Syst., 34, 2, 1-32 (2016)
[31] Cheng, Z.; Ding, Y.; Zhu, L.; Kankanhalli, M. S., Aspect-aware latent factor model: rating prediction with ratings and reviews, (The Web Conference (2018)), 639-648
[32] Lee, D. D.; Seung, H. S., Algorithms for non-negative matrix factorization, Neural Inf. Process. Syst., 556-562 (2001)
[33] Wang, Z.; Shao, Y.; Bai, L.; Deng, N., Twin support vector machine for clustering, IEEE Trans. Neural Networks, 26, 10, 2583-2588 (2015)
[34] Bai, L.; Shao, Y.; Wang, Z.; Li, C., Clustering by twin support vector machine and least square twin support vector classifier with uniform output coding, Knowl. Based Syst., 163, 227-240 (2019)
[35] Seung, H. S.; Lee, D. D., The manifold ways of perception, Science, 290, 5500, 2268-2269 (2000)
[36] Spielman, D. A., Spectral graph theory and its applications, Found. Comput. Sci., 29-38 (2007)
[37] Hidru, D.; Goldenberg, A., Equinmf: graph regularized multiview nonnegative matrix factorization, Comput. Sci. (2014)
[38] Zong, L.; Zhang, X.; Zhao, L.; Yu, H.; Zhao, Q., Multi-view clustering via multi-manifold regularized non-negative matrix factorization, Neural Networks, 88, 88, 74-89 (2017) · Zbl 1434.68493
[39] Guan, Z.; Zhang, L.; Peng, J.; Fan, J., Multi-view concept learning for data representation, IEEE Trans. Knowl. Data Eng., 27, 11, 3016-3028 (2015)
[40] Xu, C.; Guan, Z.; Zhao, W.; Niu, Y.; Wang, Q.; Wang, Z., Deep multi-view concept learning, (International Joint Conference on Artificial Intelligence (2018)), 2898-2904
[41] Wang, J.; Wang, X.; Tian, F.; Liu, C. H.; Yu, H.; Liu, Y., Adaptive multi-view semi-supervised nonnegative matrix factorization, International Conference on Neural Information Processing, 435-444 (2016)
[42] Wang, Z.; Kong, X.; Fu, H.; Li, M.; Zhang, Y., Feature extraction via multi-view non-negative matrix factorization with local graph regularization, (International Conference on Image Processing (2015)), 3500-3504
[43] He, X.; Kan, M. Y.; Xie, P.; Chen, X., Comment-based multi-view clustering of web 2.0 items, International World Wide Web Conferences, 771-782 (2014)
[44] Wang, H.; Yang, Y.; Li, T., Multi-view clustering via concept factorization with local manifold regularization, (International Conference on Data Mining (2016)), 1245-1250
[45] Nie, F.; Li, J.; Li, X., Self-weighted multiview clustering with multiple graphs, (International Joint Conference on Artificial Intelligence (2017)), 2564-2570
[46] Houthuys, L.; Langone, R.; Suykens, J. A.K., Multi-view kernel spectral clustering, Inf. Fusion, 44, 46-56 (2018)
[47] Zhou, T.; Zhang, C.; Peng, X.; Bhaskar, H.; Yang, J., Dual shared-specific multiview subspace clustering, IEEE Trans. Syst. Man Cybern., 1-14 (2019)
[48] Zhang, C.; Fu, H.; Hu, Q.; Cao, X.; Xie, Y.; Tao, D.; Xu, D., Generalized latent multi-view subspace clustering, IEEE Trans. Pattern Anal. Mach. Intell., 1-14 (2019)
[49] Nie, F.; Cai, G.; Li, X., Multi-view clustering and semi-supervised classification with adaptive neighbours, (National Conference on Artificial Intelligence (2017)), 2408-2414
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.