Semi-supervised sentiment clustering on natural language texts. (English) Zbl 07777998
Stat. Methods Appl. 32, No. 4, 1239-1257 (2023); correction ibid. 32, No. 4, 1379-1380 (2023).
Summary: In this paper, we propose a semi-supervised method to cluster unstructured textual data called semi-supervised sentiment clustering on natural language texts. The aim is to identify clusters homogeneous with respect to the overall sentiment of the texts analyzed. The method combines different techniques and methodologies: Sentiment Analysis, Threshold-based Naïve Bayes classifier, and Network-based Semi-supervised Clustering. It involves different steps. In the first step, the unstructured text is transformed into structured text, and it is categorized into positive or negative classes using a sentiment analysis algorithm. In the second step, the Threshold-based Naïve Bayes classifier is applied to identify the overall sentiment of the texts and to define a specific sentiment value for the topics. In the last step, Network-based Semi-supervised Clustering is applied to partition the instances into disjoint groups. The proposed algorithm is tested on a collection of reviews written by customers on Booking.com. The results have highlighted the capacity of the proposed algorithm to identify clusters that are distinct, non-overlapped, and homogeneous with respect to the overall sentiment. Results are also easily interpretable thanks to the network representation of the instances that helps to understand the relationship between them.
MSC:
| 62-XX | Statistics |
References:
| [1] | Agarwal, B.; Mittal, N., Machine learning approach for sentiment analysis, 21-45 (2016), Cham: Springer, Cham |
| [2] | Baek, S.; Jung, W.; Han, SH, A critical review of text-based research in construction: data source, analysis method, and implications, Autom Constr, 132, 103, 915 (2021) |
| [3] | Bair, E., Semi-supervised clustering methods, Wiley Interdiscipl Rev Comput Stat, 5, 5, 349-361 (2013) · Zbl 07915799 · doi:10.1002/wics.1270 |
| [4] | Basu S, Bilenko M, Mooney RJ (2004) A probabilistic framework for semi-supervised clustering. In: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, pp 59-68 |
| [5] | Bilenko M, Basu S, Mooney RJ (2004) Integrating constraints and metric learning in semi-supervised clustering. In: Proceedings of the 21st international conference on Machine learning, p 11 |
| [6] | Darwich, M.; Mohd, SA; Omar, N., Corpus-based techniques for sentiment lexicon generation: a review, J Digit Inf Manag, 17, 5, 296 (2019) |
| [7] | Eguchi K, Lavrenko V (2006) Sentiment retrieval using generative models. In: Proceedings of the 2006 conference on empirical methods in natural language processing, pp 345-354 |
| [8] | Frigau, L.; Contu, G.; Mola, F., Network-based semisupervised clustering, Appl Stoch Model Bus Ind, 37, 2, 182-202 (2021) · Zbl 07887591 · doi:10.1002/asmb.2618 |
| [9] | Gaikwad SV, Chaugule A, Patil P (2014) Text mining methods and techniques. Int J Comput Appl 85(17) |
| [10] | Gandomi, A.; Haider, M., Beyond the hype: big data concepts, methods, and analytics, Int J Inf Manag, 35, 2, 137-144 (2015) · doi:10.1016/j.ijinfomgt.2014.10.007 |
| [11] | Gao J, Tan PN, Cheng H (2006) Semi-supervised clustering with partial background information. In: Proceedings of the 2006 SIAM international conference on data mining, SIAM, pp 489-493 |
| [12] | Goldberg AB, Zhu X (2006) Seeing stars when there aren’t many stars: graph-based semi-supervised learning for sentiment categorization. In: Proceedings of TextGraphs: the first workshop on graph based methods for natural language processing, pp 45-52 |
| [13] | Goldberg, Y., Neural network methods for natural language processing, Synth Lect Hum Lang Technol, 10, 1, 1-309 (2017) · doi:10.1007/978-3-031-02165-7 |
| [14] | Gowda HS, Suhil M, Guru D, et al (2016) Semi-supervised text categorization using recursive k-means clustering. In: International conference on recent trends in image processing and pattern recognition. Springer, pp 217-227 |
| [15] | Grira N, Crucianu M, Boujemaa N (2004) Unsupervised and semi-supervised clustering: a brief survey. A review of machine learning techniques for processing multimedia content 1:9-16 |
| [16] | Hang, W.; Choi, KS; Wang, S., Semi-supervised learning using hidden feature augmentation, Appl Soft Comput, 59, 448-461 (2017) · doi:10.1016/j.asoc.2017.06.017 |
| [17] | He, Y.; Zhou, D., Self-training from labeled features for sentiment analysis, Inf Process Manag, 47, 4, 606-616 (2011) · doi:10.1016/j.ipm.2010.11.003 |
| [18] | Hu X, Tang J, Gao H, et al (2013) Unsupervised sentiment analysis with emotional signals. In: Proceedings of the 22nd international conference on World Wide Web, pp 607-618 |
| [19] | Jain, AK; Murty, MN; Flynn, PJ, Data clustering: a review, ACM Comput Surv (CSUR), 31, 3, 264-323 (1999) · doi:10.1145/331499.331504 |
| [20] | Kaur H, Mangat V et al (2017) A survey of sentiment analysis techniques. In: 2017 International conference on I-SMAC in social mobile, analytics and cloud (IoT) (I-SMAC), IEEE, pp 921-925 |
| [21] | Kestler HA, Kraus JM, Palm G, et al (2006) On the effects of constraints in semi-supervised hierarchical clustering. In: IAPR workshop on artificial neural networks in pattern recognition, Springer, pp 57-66 |
| [22] | Kleiber A (2002) An \(\{\) R \(\}\) package for testing for structural change in linear regression models. An \(\{\) R \(\}\) Package for Testing for Structural 7(2) |
| [23] | Krijthe JH, Van der Maaten L (2015) Rtsne: T-distributed stochastic neighbor embedding using barnes-hut implementation. R package version 013. https://github.com/jkrijthe/Rtsne |
| [24] | Liu, B., Sentiment analysis and opinion mining, Synth Lect Hum Lang Technol, 5, 1, 1-167 (2012) · doi:10.1007/978-3-031-02145-9 |
| [25] | Madhoushi Z, Hamdan AR, Zainudin S (2015) Sentiment analysis techniques in recent works. In: 2015 science and information conference (SAI), IEEE, pp 288-291 |
| [26] | Nanli Z, Ping Z, Weiguo L, et al (2012) Sentiment analysis: a literature review. In: 2012 International symposium on management of technology (ISMOT), IEEE, pp 572-576 |
| [27] | Nigam, K.; McCallum, AK; Thrun, S., Text classification from labeled and unlabeled documents using EM, Mach Learn, 39, 2, 103-134 (2000) · Zbl 0949.68162 · doi:10.1023/A:1007692713085 |
| [28] | Nogueira BM, Tomas YKB, Marcacini RM (2017) Integrating distance metric learning and cluster-level constraints in semi-supervised clustering. In: 2017 International joint conference on neural networks (IJCNN), IEEE, pp 4118-4125 |
| [29] | Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends® Inf Retrieval 2:1-2(1-2):1-135 |
| [30] | Raghavan, UN; Albert, R.; Kumara, S., Near linear time algorithm to detect community structures in large-scale networks, Phys Rev E, 76, 3 (2007) · doi:10.1103/PhysRevE.76.036106 |
| [31] | Sadr, H.; Pedram, MM; Teshnehlab, M., Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis, IEEE Access, 8, 86984-86997 (2020) · doi:10.1109/ACCESS.2020.2992063 |
| [32] | Schuckert, M.; Liu, X.; Law, R., A segmentation of online reviews by language groups: how English and non-English speakers rate hotels differently, Int J Hosp Manag, 48, 143-149 (2015) · doi:10.1016/j.ijhm.2014.12.007 |
| [33] | Silva, NFFD; Coletta, LF; Hruschka, ER, A survey and comparative study of tweet sentiment analysis via semi-supervised learning, ACM Comput Surv (CSUR), 49, 1, 1-26 (2016) |
| [34] | Sodanil M (2016) Multi-language sentiment analysis for hotel reviews. In: MATEC web of conferences, EDP Sciences, p 03002 |
| [35] | Sparks, BA; Perkins, HE; Buckley, R., Online travel reviews as persuasive communication: the effects of content type, source, and certification logos on consumer behavior, Tour Manag, 39, 1-9 (2013) · doi:10.1016/j.tourman.2013.03.007 |
| [36] | Sun Z, Ye Y, Zhang X, et al (2012) Batch-mode active learning with semi-supervised cluster tree for text classification. In: 2012 IEEE/WIC/ACM international conferences on web intelligence and intelligent agent technology, IEEE, pp 388-395 |
| [37] | Taboada, M.; Brooke, J.; Tofiloski, M., Lexicon-based methods for sentiment analysis, Comput Linguist, 37, 2, 267-307 (2011) · doi:10.1162/COLI_a_00049 |
| [38] | Vallejo-Huanga, D.; Morillo, P.; Ferri, C., Semi-supervised clustering algorithms for grouping scientific articles, Procedia Comput Sci, 108, 325-334 (2017) · doi:10.1016/j.procs.2017.05.206 |
| [39] | Van Der Maaten L (2010) Fast optimization for t-sne. In: In 2010 Workshop on challenges in data visualization neural information processing systems (NIPS) |
| [40] | Van der Maaten L, Hinton G (2008) Visualizing data using t-sne. J Mach Learn Res 9(11) · Zbl 1225.68219 |
| [41] | Vashishtha, S.; Susan, S., Fuzzy rule based unsupervised sentiment analysis from social media posts, Expert Syst Appl, 138, 112, 834 (2019) |
| [42] | Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998-6008 |
| [43] | Wan X (2009) Co-training for cross-lingual sentiment classification. In: Proceedings of the joint conference of the 47th annual meeting of the ACL and the 4th international joint conference on natural language processing of the AFNLP, pp 235-243 |
| [44] | Wang X, Wei F, Liu X, et al (2011) Topic sentiment analysis in twitter: a graph-based hashtag sentiment classification approach. In: Proceedings of the 20th ACM international conference on information and knowledge management, pp 1031-1040 |
| [45] | Xiang G, Min W (2010) Applying semi-supervised cluster algorithm for anomaly detection. In: 2010 3rd International symposium on information processing, IEEE, pp 43-45 |
| [46] | Yi J, Zhang L, Yang T, et al (2015) An efficient semi-supervised clustering algorithm with sequential constraints. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1405-1414 |
| [47] | Yoshida, T., A graph-based approach for semisupervised clustering, Comput Intell, 30, 2, 263-284 (2014) · doi:10.1111/j.1467-8640.2012.00450.x |
| [48] | Yu, Z.; Luo, P.; You, J., Incremental semi-supervised clustering ensemble for high dimensional data clustering, IEEE Trans Knowl Data Eng, 28, 3, 701-714 (2016) · doi:10.1109/TKDE.2015.2499200 |
| [49] | Zeileis, A.; Kleiber, C.; Krämer, W., Testing and dating of structural changes in practice, Comput Stat Data Anal, 44, 1-2, 109-123 (2003) · Zbl 1429.62307 · doi:10.1016/S0167-9473(03)00030-6 |
| [50] | Zhang, W.; Tang, X.; Yoshida, T., Tesc: an approach to text classification using semi-supervised clustering, Knowl-Based Syst, 75, 152-160 (2015) · doi:10.1016/j.knosys.2014.11.028 |
| [51] | Zhu, X.; Goldberg, AB, Introduction to semi-supervised learning, Synthesis lectures on artificial intelligence and machine learning, 3, 1, 1-130 (2009) · Zbl 1209.68435 · doi:10.1007/978-3-031-01548-9 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
