The impact of language consistency on the perceived quality of consumer reviews: A study based on information adoption model and automated annotation of language large models
DOI:
https://doi.org/10.61173/jens6633Keywords:
Language Style Matching (LSM), Topic Matching, Perceived Review Quality, Natural Language Processing (NLP), LIWC, LDA, Information Adoption ModelAbstract
As online reviews play an increasingly important role in consumer decisions, understanding these influencing factors significantly improves review quality and user satisfaction. Based on the information adoption model, this study explores the impact of Language Style Matching (LSM) and Topic Matching on the perceived quality of user reviews. By analyzing 26,852 reviews on the Airbnb platform in California from January to May 2024, the LIWC tool was used to calculate the language style matching score of each review, and the LDA model was used to perform topic analysis to obtain the corresponding topic score. In addition, each review is scored through the GPT-3.5 model from four dimensions: specificity, clarity, emotional color, and usefulness. The research results show that language style matching and topic matching significantly affect the perceived quality of reviews, in which perceived credibility and perceived usefulness mediate in this process. Future research can use multiple language models to score reviews and calculate the scores, reducing the bias caused by a single model.
References
Hao Yuanyuan, Ye Qiang & Li Yijun. (2010). Research on the influencing factors of online review usefulness based on film review data. Journal of Management Science (08), 78-88+96.
Jiang Lin. (2020). Research on the motivation of consumer online reviews based on SET and TAM. Journal of University of Science and Technology Beijing (Social Science Edition) (01), 87-94.
Li Qi, Gao Xiayuan, Xu Xiaoyu & Qiao Zhilin. (2021). Research on information processing and purchase intention of e-commerce live broadcast viewers. Journal of Management (06), 895-903. Mao Taitian, Tang Gan, Ma Jiawei & Liu Jie. Research on the identification of influencing factors of users’ adoption intention of artificial intelligence generated content (AIGC) - Taking ChatGPT as an example. Information Science 1-15.
Meng Meng, You Jian, Liu Chenhui, & Zeng Ziming. (2024). Research on health information adoption behavior - concept definition, theoretical model and future prospects. Modern Information, 157-167.
Sun Shiwei, Wang Chuan & Jia Lin.(2023). Research on the usefulness of e-commerce platform reviews based on multi-dimensional text features. Journal of Beijing Institute of Technology (Social Science Edition) (02), 176-188. doi:10.15918/j.jbitss1009-3370.2023.3376.
Sun Jin, Zheng Yu & Chen Jing.(2020). Research on the impact of perceived online review credibility on consumer trust - the moderating role of uncertainty avoidance. Management Review (04), 146-159.doi:10.14120/j.cnki.cn11-5057/f.2020.04.012.
Wang Yani, Wang Jun, Yao Tang & Wang Taiming. (2021). What kind of reviews are more useful? A “Meta-analysis” based on ELM. Management Review (05), 246-256. doi:10.14120/j.cnki. cn11-5057/f.2021.05.013.
Yan Qiang & Meng Yue. (2013). Factors affecting the perceived usefulness of online reviews: An empirical study based on online film reviews. Chinese Management Science (S1), 126-131. doi:10.16381/j.cnki.issn1003-207x.2013.s1.059.
Zhu Liye, Yuan Denghua, & Zhang Jingyi. (2017). The impact of online user review quality and reviewer rating on consumer purchase intention: The moderating effect of product involvement. Management Review, 29(2), 87.
Deng Ge. (2023). Research on the influence of review information on purchase decisions in community group buying (Master’s thesis, Dongbei University of Finance and Economics). Master’s https://link.cnki.net/doi/10.27006/d.cnki. gdbcu.2023.000707doi:10.27006/d.cnki.gdbcu.2023.000707.
Zhou Jingjing. (2010). Research on the influence of online customer reviews on consumer purchase decisions (Master’s thesis, Zhejiang University). Master’s https://kns.cnki.net/ kcms2/article/abstract?v=VKFFl0Cm57YhBxlnp7EowNoGX8 I1xa0GrD3j4dnMdULAD4QqajxuPEgCj2EqAaLtOvvA71gU k3Ur_5iiuVYOiHv7acCGPpUUEd7qk4ifAy2rX0TyzlCKWn_ X5bXFENW33LHWB__wtFw08zwEjRpAOCYdD7mbl_YJ&u niplatform=NZKPT&language=CHS
Alshibly, H. H. (2015). Customer perceived value in social commerce: An exploration of its antecedents and consequences. Journal of Management Research, 7(1), 17-37. Babić Rosario, A., Sotgiu, F., De Valck, K., & Bijmolt, T. H. (2016). The effect of electronic word of mouth on sales: A metaanalytic review of platform, product, and metric factors. Journal of marketing research, 53(3), 297-318. Berger, J., Humphreys, A., Ludwig, S., Moe, W. W., Netzer, O., & Schweidel, D. A. (2020). Uniting the tribes: Using text for marketing insight. Journal of marketing, 84(1), 1-25.
Cao, Q., Duan, W., & Gan, Q. (2011). Exploring determinants of voting for the “helpfulness” of online user reviews: A text mining approach. Decision Support Systems, 50(2), 511-521.
Chaiken, S., & Ledgerwood, A. (2012). A theory of heuristic and systematic information processing. Handbook of theories of social psychology, 1, 246-266.
Chang, H. H., & Chen, S. W. (2008). The impact of online store environment cues on purchase intention: Trust and perceived risk as a mediator. Online information review, 32(6), 818-841.
Cheung, C. M. Y., Sia, C. L., & Kuan, K. K. (2012). Is this review believable? A study of factors affecting the credibility of online consumer reviews from an ELM perspective. Journal of the Association for Information Systems, 13(8), 2.
Coupland, N. (2007). Style: Language variation and identity. Cambridge University Press.
Dellarocas, C. (2003). The digitization of word of mouth: Promise and challenges of online feedback mechanisms. Management science, 49(10), 1407-1424. Diakopoulos, N., & Naaman, M. (2011, March). Towards quality discourse in online news comments. In Proceedings of the ACM 2011 conference on Computer supported cooperative work (pp. 133-142).
Doré, B. P., & Morris, R. R. (2018). Linguistic synchrony Dean&Francis predicts the immediate and lasting impact of text-based emotional support. Psychological Science, 29(10), 1716-1723.
Everard, A., & Galletta, D. F. (2005). How presentation flaws affect perceived site quality, trust, and intention to purchase from an online store. Journal of management information systems, 22(3), 56-95.
Filieri, R., McLeay, F., Tsui, B., & Lin, Z. (2018). Consumer perceptions of information helpfulness and determinants of purchase intention in online consumer reviews of services. Information & management, 55(8), 956-970.
Gonzales, A. L., Hancock, J. T., & Pennebaker, J. W. (2010). Language style matching as a predictor of social dynamics in small groups. Communication Research, 37(1), 3-19. Herhausen, D., Ludwig, S., Grewal, D., Wulf, J., & Schoegel, M. (2019). Detecting, preventing, and mitigating online firestorms in brand communities. Journal of marketing, 83(3), 1-21. Hu, P. J. H., Brown, S. A., Thong, J. Y., Chan, F. K., & Tam,
K. Y. (2009). Determinants of service quality and continuance intention of online services: The case of eTax. Journal of the American Society for Information Science and Technology, 60(2), 292-306.
Ireland, M. E., & Pennebaker, J. W. (2010). Language style matching in writing: synchrony in essays, correspondence, and poetry. Journal of personality and social psychology, 99(3), 549. Ireland, M. E., Slatcher, R. B., Eastwick, P. W., Scissors,
L. E., Finkel, E. J., & Pennebaker, J. W. (2011). Language style matching predicts relationship initiation and stability. Psychological science, 22(1), 39-44.
Lee, M. T., & Theokary, C. (2021). The superstar social media influencer: Exploiting linguistic style and emotional contagion over content?. Journal of Business Research, 132, 860-871.
Li, J., & Zhan, L. (2011). Online persuasion: How the written word drives WOM: Evidence from consumer-generated product reviews. Journal of Advertising Research, 51(1), 239-257.
Liu, A. X., Xie, Y., & Zhang, J. (2019). It’s not just what you say, but how you say it: The effect of language style matching on perceived quality of consumer reviews. Journal of Interactive Marketing, 46(1), 70-86. Ludwig, S., De Ruyter, K., Friedman, M., Brüggen, E. C.,
Wetzels, M., & Pfann, G. (2013). More than words: The influence of affective content and linguistic style matches in online reviews on conversion rates. Journal of marketing, 77(1), 87-103.
Niederhoffer, K. G., & Pennebaker, J. W. (2002). Linguistic style matching in social interaction. Journal of Language and Social Psychology, 21(4), 337-360.
Pennebaker, J. W., & Chung, C. K. (2007). Expressive writing, emotional upheavals, and health. Foundations of health psychology, 263-284. Petty, R. E., Cacioppo, J. T., Petty, R. E., & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion (pp. 1-24). Springer New York.
Petty, R. E., Brinol, P., & Tormala, Z. L. (2002). Thought confidence as a determinant of persuasion: the self-validation hypothesis. Journal of personality and social psychology, 82(5), 722.
Petty, R. E., Briñol, P., & Priester, J. R. (2009). Mass media attitude change: Implications of the elaboration likelihood model of persuasion. In Media effects (pp. 141-180). Routledge.
Priester, J., Wegener, D., Petty, R., & Fabrigar, L. (1999). Examining the psychological process underlying the sleeper effect: The elaboration likelihood model explanation. Media Psychology, 1(1), 27-48. Reyes-Menendez, A., Saura, J. R., & Martinez-Navalon, J. G. (2019). The impact of e-WOM on hotels management reputation: exploring tripadvisor review credibility with the ELM model. Ieee Access, 7, 68868-68877.
Shahab, M. H., Ghazali, E., & Mohtar, M. (2021). The role of elaboration likelihood model in consumer behaviour research and its extension to new technologies: A review and future research agenda. International Journal of Consumer Studies, 45(4), 664-689.
Stauss, B. (2000). Using new media for customer interaction: a challenge for relationship marketing. In Relationship marketing: Gaining competitive advantage through customer satisfaction and customer retention (pp. 233-253). Berlin, Heidelberg: Springer Berlin Heidelberg.
Sussman, S. W., & Siegal, W. S. (2003). Informational influence in organizations: An integrated approach to knowledge adoption. Information systems research, 14(1), 47-65.
Tam, K. Y., & Ho, S. Y. (2005). Web personalization as a persuasion strategy: An elaboration likelihood model perspective. Information systems research, 16(3), 271-291.
Tormala, Z. L., & Petty, R. E. (2002). What doesn’t kill me makes me stronger: The effects of resisting persuasion on attitude certainty. Journal of personality and social psychology, 83(6), 1298.
Wang, Y. (2016). Information adoption model, a review of the literature. Journal of Economics, Business and Management, 4(11), 618-622.
Zhang, K. Z., Zhao, S. J., Cheung, C. M., & Lee, M. K. (2014). Examining the influence of online reviews on consumers’ decision-making: A heuristic–systematic model. Decision Support Systems, 67, 78-89.
Zhang, Y., Moe, W. W., & Schweidel, D. A. (2017). Modeling the role of message content and influencers in social media rebroadcasting. International Journal of Research in Marketing, 34(1), 100-119.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 by the authors.
This work is licensed under a Creative Commons Attribution 4.0 International License.
