Skip to main content
Intended for healthcare professionals
Restricted access
Research article
First published online March 29, 2025

ChatGPT theses. Identifying distinctive markers in AI-generated versus human-created texts: A multimodal analysis in university education

Abstract

This study examines the distinguishing markers between AI-generated and human-created texts within university education, specifically in the context of student assignments. Using a multimodal qualitative approach, we analysed selected Bachelor’s and Master’s theses, identifying recurring characteristics of AI-generated content. Key markers include among others: fragmented argumentation flow, specific use of language, formulaic structures, and excessive objectivity, which contrast with the more nuanced and cohesive style typical of human writing. The research also includes survey responses from students across two universities (Europe & Asia), revealing varied attitudes towards AI use in academic work. While some students view AI as a beneficial tool for text enhancement, others express ethical concerns regarding its impact on authorship and originality. The findings suggest that both students and educators must adapt to the growing presence of generative AI in academia, balancing its use with critical thinking and ethical guidelines. This research provides a foundation for developing AI literacy and detection methods, highlighting the need for systematic strategies to integrate AI responsibly within educational frameworks, thus supporting academic integrity and fostering digital literacy.

Get full access to this article

View all access and purchase options for this article.

Data availability statement

Data available on request.*

References

Abdillah HZ, Partino P, Madjid A (2023) Enhancing student well-being through AI chatGPT in the smart education university learning environment: a preliminary review of research literature. In E3S Web of Conferences. Les Ulis: EDP Sciences, Vol. 440, 05005.
Chan CKY (2023) A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education 20(1): 38.
Chen Y, Kang H, Zhai V, et al. (2023) Gpt-sentinel: distinguishing human and chatgpt generated content. arXiv preprint arXiv:2305.07969.
Confino P (2024, November 2) ChatGPT Releases a Search Engine, An Opening Salvo in a Brewing War With Google for Dominance of the AI-Powered Internet. New York, NY: Fortune. https://fortune.com/2024/11/02/chatgpt-search-vs-google-ai-internet/
Crawford J, Cowling M, Allen KA (2023) Leadership is needed for ethical ChatGPT: character, assessment, and learning using artificial intelligence (AI). Journal of University Teaching and Learning Practice 20(3): 2.
Dam SK, Hong CS, Qiao Y, et al. (2024). A complete survey on llm-based ai chatbots. arXiv preprint arXiv:2406.16937.
Firat M (2023) What ChatGPT means for universities: perceptions of scholars and students. Journal of Applied Learning and Teaching 6(1): 57–63.
Fyfe P (2023) How to cheat on your final paper: assigning AI for student writing. AI & Society 38(4): 1395–1405.
George AS, George AH (2023) A review of ChatGPT AI’s impact on several business sectors. Partners Universal International Innovation Journal 1(1): 9–23.
Herbold S, Hautli-Janisz A, Heuer U, et al. (2023) A large-scale comparison of human-written versus ChatGPT-generated essays. Scientific Reports 13(1): 18617.
Hu K (2023, February 2). CHATGPT sets record for fastest-growing user base - analyst note | reuters. Reuters. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/
Huallpa JJ, Flores-Arocutipa J, Panduro WD, et al. (2023) Exploring the ethical considerations of using ChatGPT in university education. Periodicals of Engineering and Natural Sciences 11(4): 105–115.
Janner M (2024, October 31) Introducing chatgpt search | openai. Open AI. Available at: https://openai.com/index/introducing-chatgpt-search/
Kai J (2012) The origin and consequences of excess competition in education: A mainland Chinese perspective. Chinese Education & Society 45(2): 8–20.
Kalla D, Smith N, Samaah F, et al. (2023) Study and analysis of chat GPT and its impact on different fields of study. International Journal of Innovative Science and Research Technology 8(3). Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4402499
Kim Y, Lee J, Kim S, et al. (2024, March) Understanding users’ dissatisfaction with chatgpt responses: types, resolving tactics, and the effect of knowledge level. In Proceedings of the 29th International Conference on Intelligent User Interfaces, Greenville, SC, 385–404.
Lacey MM, Smith DP (2023) Teaching and assessment of the future today: higher education and AI. Microbiology Australia 44(3): 124–126.
Liao W, Liu Z, Dai H, et al. (2023) Differentiate chat GPT-generated and human-written medical texts. arXiv 2023. arXiv preprint arXiv:2304.11567.
Maleki N, Padmanabhan B, Dutta K (2024, June) AI hallucinations: a misnomer worth clarifying. In 2024 IEEE Conference on Artificial Intelligence (CAI). IEEE, 133–138.
Memarian B, Doleck T (2024) (Un) employment of AI in higher education. SN Computer Science 5(7): 812–818.
Nazir A, Wang Z (2023) A comprehensive survey of ChatGPT: advancements, applications, prospects, and challenges. Meta-radiology 1: 100022.
Pedro F, Subosa M, Rivas A, et al. (2019, January 1) Artificial Intelligence in education: Challenges and opportunities for Sustainable Development. Ministerio de Educacion. Available at: https://repositorio.minedu.gob.pe/handle/20.500.12799/6533.
Rogers MP, Hillberg HM, Groves CL (2024) Attitudes towards the use (and misuse) of ChatGPT: a preliminary study. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education, Toronto, ON, Vol. 1, 1147–1153.
Scarfe P, Watcham K, Clarke A, et al. (2024) A real-world test of artificial intelligence infiltration of a university examinations system: a “Turing Test” case study. PLoS One 19(6): e0305354.
Smerdon D (2024) AI in essay-based assessment: student adoption, usage, and performance. Computers and Education: Artificial Intelligence 7: 100288.
Sweeney S (2023, June) Academic dishonesty, essay mills, and artificial intelligence: rethinking assessment strategies. In 9th International Conference on Higher Education Advances (HEAd’23), 19–22.
Tajik E, Tajik F (2024, January 18) A Comprehensive Examination of the Potential Application of Chat GPT in Higher Education Institutions. Available at: https://doi.org/10.2139/ssrn.4699304
Wei Q (2023) Changes in English language education and strategies for coping against chat GPT’s effects. Advances in Education, Humanities and Social Science Research 6(1): 471.
Wu Y (2023) Integrating generative AI in education: how ChatGPT brings challenges for future learning and teaching. Journal of Advanced Research in Education 2(4): 6–10.
Yan D, Gao Z, Liu Z (2023, September). A closer look at different difficulty levels code generation abilities of chatgpt. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) (pp. 1887-1898). IEEE.
Yu H (2023) Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Frontiers in Psychology 14: 1181712.
Zhao X (2015) Competition and Compassion in Chinese Secondary Education. New York, NY: Palgrave Macmillan.

Biographies

Dr. Lukasz Nowacki is a Senior Lecturer at Wszechnica Polska University of Applied Sciences in Warsaw, Poland. His research interests include media framing, algorithms and AI in social media, digital cultures, and new digital media. He holds a Ph.D. in English and Communication Studies from the University of Nottingham, an M.A. in International Communication from the Communication University of China, and an M.A. in English Studies (Translation) from the University of Warsaw. He has extensive professional experience in the media industry, having worked for several years as a media content specialist at various television stations. He has also participated in international media festivals and markets around the world.
Dr. Agata Ewa Wrochna is a Lecturer in Communication at Wenzhou-Kean University. She received her PhD in Culture Studies from the School of International Communications at the University of Nottingham. She has worked as a tutor and researcher at numerous international institutions, including several Sino-foreign universities across China. Dr. Wrochna has significant teaching and research experience in communication, culture, and media. She is also an Associate Fellow of the Higher Education Academy.