THE IMPACT OF AI ON PRAGMATIC COMPETENCE
Abstract
The pragmatic ability of artificial intelligence systems is one of the critical but under-researched areas in the research area, especially in recent times, with increased reliance on AI technologies in human communication. This study responds to the main question of the difficulties AI systems encounter in comprehending human pragmatic signals, and how these interactions affect communication dynamics. This study has, therefore, adopted qualitative and descriptive research approaches to analyze interaction data obtained from WildChat and OpenAI logs, focusing on pragmatic functions like requests, agreements, and questions. Data collection depended on anonymized natural conversations in real life, while the analytical model used theoretical frameworks first, Grice's Cooperative Principle, then Relevance Theories assess how well AI performs in interpreting implicit meanings and cultural nuances. Key findings indicate that, while AI performs well with explicit speech acts, it fails in dealing with indirectness, ambiguity, and cultural variability. Repeated interactions with AI thus lead users to simplify their communication, which gives rise to concerns about the erosion of human pragmatic abilities. The study provides conclusions for addressing the pragmatic limitations of AI in a way that could promote more natural and contextually appropriate human-AI communication. The implications of these findings for AI design, linguistic theory, and societal norms are huge.
Keywords
Full Text:
PDFReferences
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Ser, J. D., Díaz-Rodríguez, N., & Herrera, F. (2023). Explainable Artificial Intelligence (XAI): What we know and what is left to attain trustworthy Artificial Intelligence. Information Fusion, 99, 101805. https://doi.org/10.1016/j.inffus.2023.101805
Altinok, D. (2021). Mastering spaCy: An end-to-end practical guide to implementing NLP applications using the Python ecosystem. Birmingham: Packt Publishing Ltd.
Austin, J. L. (1962). How to do things with words. Oxford: Oxford University Press.
Ayanouz, S., Abdelhakim, B. A., & Benhmed, M. (2020). A smart Chabot architecture based NLP and machine learning for health care assistance. In Proceedings of the 3rd International Conference on Networking, Information Systems & Security (NISS '20). Association for Computing Machinery, New York, USA, Article 78, (pp.1–6). https://doi.org/10.1145/3386723.3387897
Bansal, G., Chamola, V., Hussain, A., Guizani, M., & Niyato, D. (2024). Transforming conversations with AI—A comprehensive study of ChatGPT. Cognitive Computation, 16, 2487–2510. https://doi.org/10.1007/s12559-023-10236-2
Blome‐Tillmann, M. (2013). Conversational implicatures (and how to spot them). Philosophy Compass, 8(2), 170-185. https://doi.org/10.1111/phc3.12003
Briggs, G., Williams, T., & Scheutz, M. (2017). Enabling robots to understand indirect speech acts in task-based interactions. Journal of Human-Robot Interaction, 6(1), 64-94. https://doi.org/10.5898/JHRI.6.1.Briggs
Chen, X., Li, J., & Ye, Y. (2024). A feasibility study for the application of AI-generated conversations in pragmatic analysis. Journal of Pragmatics, 223, 14-30. https://doi.org/10.1016/j.pragma.2024.01.003
Chen, K., Shao, A., Burapacheep, J., & Li, Y. (2024). Conversational AI and equity through assessing GPT-3’s communication with diverse social groups on contentious topics. Scientific Reports, 14, 1561. https://doi.org/10.1038/s41598-024-51969-w
Coulmas, F. (2013). The study of speakers’ choices. Cambridge: Cambridge University Press.
Cutting, J. (2002). Pragmatics and discourse: A resource book for students. London: Routledge. https://doi.org/10.4324/9780203994597
Dini, S. (2023). Speech act classification in computational linguistics using supervised machine learning models; the interdisciplinary context of pragmatics and natural language processing. [PhD dissertation, Drexel University].
Duffy, G. (2008). Pragmatic Analysis. In A. Klotz, & D. Prakash (Eds.), Qualitative methods in international Relations, research methods Series. London: Palgrave Macmillan. https://doi.org/10.1057/9780230584129_11
Eragamreddy, N. (2021). A semantic study of speech acts in pragmatic inferences. ELC Research Gate, 2, 47-53.
Eragamreddy, N. (2022). A semantic study of implicatures. ELC Research Gate, 3, 41-51.
Eragamreddy, N. (2024). Navigating implicit meanings: The pragmatic function of presuppositions in communication. International Journal of Linguistics and Translation Studies, 5(3), 1-18. https://doi.org/10.36892/ijlts.v5i3.463
Francesch, P., & Payrató, L. (2024). Pragmatic ambiguity, implicatures, and translation. Studia Linguistica, 78(1), 156-185. https://doi.org/10.1111/stul.12219
Gerlich, M. (2025). AI Tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), 6. https://doi.org/10.3390/soc15010006
Getchell, K. M., Carradini, S., Cardon, P. W., Fleischmann, C., Ma, H., Aritz, J., & Stapp, J. (2022). Artificial Intelligence in business communication: The changing landscape of research and teaching. Business and Professional Communication Quarterly, 85(1), 7-33. https://doi.org/10.1177/23294906221074311
Grice, H.P. (1975). Logic and conversation. London: University of California Press.
Gupta, A., Hathwar, D., & Vijayakumar, A. (2020). Introduction to AI chatbots. International Journal of Engineering Research and Technology (IJERT), 9(7), 255-258. http://dx.doi.org/10.17577/IJERTV9IS070143
Guzman, A. L., & Lewis, S. C. (2020). Artificial Intelligence and communication: A human–machine communication research agenda. New Media & Society, 22(1), 70-86. https://doi.org/10.1177/1461444819858691
Hill, J., Ford, W. R., & Farreras, I. G. (2015). Real conversations with ArtificialIntelligence: A comparison between human–human online conversations and human–chatbot conversations. Computers in Human Behavior, 49, 245-250. https://doi.org/10.1016/j.chb.2015.02.026
Hohenstein, J., Kizilcec, R. F., DiFranzo, D., Aghajari, Z., Mieczkowski, H., Levy, K., Naaman, M., Hancock, J., &Jung, M. F. (2023). Artificial Intelligence in communication impacts language and social relationships. Scientific Reports, 13(1), 5487. https://doi.org/10.1038/s41598-023-30938-9
Hurford, J. R., Heasley, B., & Smith, M. B. (2007). Semantics: A course book. Cambridge: Cambridge University Press.
Irmawati, D. K. (2019). Pragmatic aspects in role-play activity in teaching speaking. EDUCAFL: Journal on Education of English as Foreign Language, 2(1), 1-7. https://doi.org/10.21776/ub.Educafl.2019.002.1.1
Irving, G., & Askell, A. (2019). AI safety needs social scientists. Distill, 4(2), e14. https://doi.org/10.23915/distill.00014
Islamov, R. (2021). The risky influence of Artificial Intelligence technologies on the foreign language proficiency of Eurasian students in mining. In E3S Web of Conferences (Vol. 278, p. 03028). EDP Sciences. https://doi.org/10.1051/e3sconf/202127803028
Janiesch, C., Zschech, P., & Heinrich, K. (2021). Machine learning and deep learning. Electronic Markets, 31(3), 685695. https://doi.org/10.1007/s12525-021-00475-2
Kang, G. C., Kim, J., Kim, J., & Zhang, B. T. (2024). Prograsp: Pragmatic human-robot communication for object grasping. In 2024 IEEE International Conference on Robotics and Automation (ICRA) (pp. 3304-3310). IEEE. https://doi.org/0.1109/ICRA57147.2024.10610543
Kim, J., Giroux, M., & Lee, J. C. (2021). When do you trust AI? The effect of number presentation detail on consumer trust and acceptance of AI recommendations. Psychology & Marketing, 38(7), 1140-1155. https://doi.org/10.1002/mar.21498
Kim, Y., & Namkung, Y. (2024). Methodological characteristics in technology-mediated ask-based language teaching research: Current practices and future directions. Annual Review of Applied Linguistics, 1–23. doi:10.1017/S0267190524000096
Kumalasari, F. (2011). The types of illocutionary and perlocutionary acts as found in an American movie entitled grown ups, [B A thesis, Andalas University].
Lee, L. W., Dabirian, A., McCarthy, I. P., & Kietzmann, J. (2020). Making sense of text: Artificial Intelligence Enabled content analysis. European Journal of Marketing, 54(3), 615-644. https://doi.org/10.1108/EJM-02-2019-0219
Levinson, S. C. (1983). Pragmatics. Cambridge: Cambridge University Press.
Levinson, S. C. (2013). Recursion in pragmatics. Language, 89(1), 149–162. http://www.jstor.org/stable/23357724
Maruthi, S., Dodda, S. B., Yellu, R. R., Thuniki, P., & Reddy, S. R. B. (2021). Deconstructing the semantics of human centric AI: A linguistic analysis. Journal of Artificial Intelligence Research and Applications, 1(1), 11-30. https://aimlstudies.co.uk/index.php/jaira/article/view/24
Metcalfe, J. S., Perelman, B. S., Boothe, D. L., & Mcdowell, K. (2021). Systemic versimplification limits the potential for human-AI partnership. IEEE Access, 9, 70242-70260. https://doi.org/0.1109/ACCESS.2021.3078298
Mey, J. L. (2001). Pragmatics: An Introduction. Oxford: Blackwell.
Nazeer, I., Khan, N. M., Nawaz, A., & Rehman, J. (2024). An experimental analysis of pragmatic competence in human-ChatGPT conversations. Pakistan Journal of Humanities and Social Sciences, 12(1), 424–435. https://doi.org/10.52131/pjhss.2024.v12i1.2061
Oaksford, M., & Chater, N. (2007). Bayesian rationality: The probabilistic approach to human reasoning. Oxford: Oxford University Press.
O'Grady, S. (2023). An AI generated test of pragmatic competence and connected speech Language Teaching Research Quarterly, 37, 188-203. https://doi.org/10.32038/ltrq.2023.37.10
Owoc, M. L., Sawicka, A., & Weichbroth, P. (2021). Artificial Intelligence technologies in education: Benefits, challenges and strategies of implementation. In M. L. Owoc, M. Pondel (Eds.), Artificial Intelligence for knowledge management (pp. 37-58). AI4KM 2019. IFIP Advances in Information and Communication Technology Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-85001-2_4
Panfili, L., Duman, S., Nave, A., Ridgeway, K. P., Eversole, N., & Sarikaya, R. (2021).
Human-AI interactions through a Gricean lens. Proceedings of the Linguistic Society of America, 6(1), 288-302. https://doi.org/10.3765/plsa.v6i1.4971
Parker, F. (1986). Linguistics for non linguist. London: Taylor and Francis.
Pinhanez. C. S. (2020). HCI research challenges for the next generation of conversational systems. In Proceedings of the 2nd Conference on Conversational User Interfaces (CUI '20). Association for Computing Machinery, New York, NY, USA, Article 48, 1–4. https://doi.org/10.1145/3405755.3406153
Pustejovsky, J., & Krishnaswamy, N. (2019, August 2-5). Multimodal continuation-style architectures for human-robot interaction. In ACS 2019 Workshop on Cognitive Vision. Massachusetts, United States. http://dx.doi.org/10.48550/arXiv.1909.08161
Rodriguez, M. Y., & Storer, H. (2020). A computational social science perspective on qualitative data exploration: Using topic models for the descriptive analysis of social media data. Journal of Technology in Human Services, 38(1), 54–86. https://doi.org/10.1080/15228835.2019.1616350
Roumbanis, L. (2025). On the present-future impact of AI technologies on personnel selection and the exponential increase in meta-algorithmic judgments. Futures, 166, 103538. https://doi.org/10.1016/j.futures.2025.103538
Sadikovna, S. G., Mansurovna, V. F., Salixovna, R. D., Xikmatullayevna, I. I., & Bobajanov, B. (2024). The role of AI and Web 2.0 tools in developing pragmatic competence of L2 English learners. SPAST Reports, 1(7). https://doi.org/10.69848/sreports.v1i7.5098
Searle, J.R. (1979). Expression and meaning: Studies in the theory of speech acts. Cambridge: Cambridge University Press.
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of Artificial Intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18(54), 1-23. https://doi.org/10.1186/s41239-021-00292-9
Shokirova, K. N. (2020). The issue of speech act in pragmatics. ISJ Theoretical & Applied Science, 86(6), 28-32. https://dx.doi.org/10.15863/TAS.2020.06.86.5
Shorey, S., Ang, E., Ng, E. D., Yap, J., Lau, L. S. T., & Chui, C. K. (2020). Communication skills training using virtual reality: A descriptive qualitative study. Nurse Education Today, 94, 104592. https://doi.org/10.1016/j.nedt.2020.104592
Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843
Sousa, S., Lamas, D., Cravino, J., & Martins, P. (2023). Human-centered trustworthy framework: A human–computer interaction perspective. Computer, 57(3), 46-58. https://doi.org/10.1109/MC.2023.3287563
Teodorescu, B., & Păun, M. G. (2014). A fly over the barriers of communication. International Letters of Social and Humanistic Sciences, 39, 85-91. https://doi.org/10.18052/www.scipress.com/ILSHS.39.85
Tourimpampa, A., Drigas, A., Economou, A., & Roussos, P. (2018). Perception and text comprehension. It’s a matter of perception! International Journal of Emerging Technologies in Learning, 13(7), 228 242. https://doi.org/10.3991/ijet.v13i07.7909
Trilling, D., & Jonkman, J. G. (2021). Open access: Scaling up content analysis. In W.van Atteveldt, & T. Peng (Eds.), Computational methods for communication science (pp. 78-94). New York: Routledge. https://doi.org/10.4324/9781003082606
Varshaa, A., Vinitha, V., Nandhini, U. D., Yogeshwaran, R.., & Soundharya, B. M. (2019). Artificial Intelligence and its applications: A review. International Research Journal on Advanced Science Hub, 2(2), 1-4. https://doi.org/10.47392/irjash.2019.11
Verschueren, J., & Östman, J. O. (2022). Handbook of pragmatics. Amsterdam: John Benjamins Publishing Company. http://digital.casalini.it/9789027210906
Wadhawan, K., & Kaur, A. (2023). AI: Job creator or jobless future. International Journal for Multidisciplinary Research (IJFMR), 5(4), 1-9. https://doi.org/10.36948/ijfmr.2023.v05i04.4520
Wang, Y., & Liu, W. (2023). Emotional simulation of Artificial Intelligence and its ethical reflection. Academic Journal of Humanities & Social Sciences, 6(5), 11-15. https://dx.doi.org/10.25236/AJHSS.2023.060503
Wijana, D. P. (1996). Basics of pragmatics. Yogyakarta: Andi Offset.
WildChat. (2024). Allen institute for Artificial Intelligence. https://wildchat.allen.ai/
Wilson, D., & Sperber, D. (2006). Relevance theory. In L. R. Horn, & G. Ward (Eds.), The handbook of pragmatics (pp.606-632). Oxford: Blackwell. https://dx.doi.org/10.1002/9780470756959
Wodak, R. (2007). Pragmatics and critical discourse analysis: A cross-disciplinary inquiry. Pragmatics & Cognition, 15(1), 203-225. https://doi.org/10.1075/pc.15.1.13wod
Wölfel, M., Shirzad, M. B., Reich, A., & Anderer, K. (2024). Knowledge-based and generative-AI-driven pedagogical conversational agents: A comparative study of Grice’s cooperative principles and trust. Big Data and Cognitive Computing, 8(1), 2. https://doi.org/10.3390/bdcc8010002
Yang, S. J., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered Artificial Intelligence in education: Seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2, 100008. https://doi.org/10.1016/j.caeai.2021.100008
Yeboah, J. (2021). The principles underlying what is communicated and not said: A cursory discussion of Grice’s cooperative principle and its maxims. Journal of English Language Teaching and Applied Linguistics, 3(5), 10-17. https://doi.org/10.32996/jeltal.2021.3.5.2
Yildirim-Erbasli, S. N., & Bulut, O. (2023). Conversation-based assessment: A novel approach to boosting test-taking effort in digital formative assessment. Computers and Education: Artificial Intelligence, 4, 100135. https://doi.org/10.1016/j.caeai.2023.100135
Yuldasheva, F. (2024). Gricean maxims of conversational cooperation. Models and Methods in Modern Science, 3(3), 57-61. https://doi.org/10.5281/zenodo.10774967
Yule, G. (1996). Pragmatics. Oxford: Oxford University Press.
Zhai, C., & Wibowo, S. (2023). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, 100134. https://doi.org/10.1016/j.caeai.2023.100134
Zou, L. (2024). Creative computing in language understanding: A novel approach to pragmatic analysis [Doctoral dissertation, University of Leicester].
DOI: https://doi.org/10.22190/JTESAP250122015E
Refbacks
- There are currently no refbacks.
ISSN 2334-9182 (Print)
ISSN 2334-9212 (Online)