Writing with ChatGPT: The impact of educational tool for undergraduate information science students' assignments
List of Authors
  • Nurfaizah Kamarudin , Suhaida Halamy

Keyword
  • ChatGPT, artificial intelligence, educational technology, impact, undergraduate students

Abstract
  • ChatGPT, a cutting-edge conversational AI developed by OpenAI, has quickly gained widespread popularity due to its remarkable ability to mimic natural human language and tackle a diverse range of tasks. Powered by deep learning, this AI chatbot can seamlessly answer questions, hold dynamic conversations, and generate content based on user prompts. ChatGPT has emerged as a pivotal tool in education, acting as a virtual assistant capable of understanding user needs, offering personalized learning experiences, and expanding access to knowledge across various fields of study. This study seeks to explore whether ChatGPT serves as a valuable educational tool or poses notable challenges for students. Additionally, it delves into the impact of ChatGPT on students' academic development while using the application. The quantitative research study surveyed 240 undergraduate information science students who have integrated ChatGPT into their learning. A significant portion of students (46%) expressed intentions to continue using the platform. However, concerns arose regarding its effects on critical thinking, over-reliance on technology, and issues related to privacy and information accuracy. The findings of this study will be crucial for educators, researchers, and students in providing insights into the effective use of ChatGPT in educational settings. With careful use and awareness of its limitations, ChatGPT and similar technologies can be invaluable educational resources for students.

Reference
  • 1. Abbas, N., Whitfield, J., Atwell, E., Bowman, H., Pickard, T., & Walker, A. (2022). Online chat and chatbots to enhance mature student engagement in higher education. International Journal of Lifelong Education, 41(3), 308-326. https://doi.org/10.1080/02601370.2022.2066213

    2. Baidoo-Anu, D., & Ansah, L. (2023). Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning. Journal of AI, 7. https://doi.org/10.61969/jai.1337500

    3. Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228-239. https://doi.org/10.1080/14703297.2023.2190148

    4. Dale, R. (2021). GPT-3 What’s it good for? Natural Language Engineering, 27(1), 113-118.

    5. Dergaa, I., Chamari, K., Zmijewski, P., & Ben Saad, H. (2023). From Human Writing to Artificial Intelligence Generated Text: Examining the Prospects and potential threats of ChatGPT in Academic Writing. Biology of Sport, 40, 615-622. https://doi.org/10.5114/biolsport.2023.125623

    6. Duong, C. D., Nguyen, T. H., Ngo, T. V. N., Dao, V. T., Do, N. D., & Pham, T. V. (2024). Exploring higher education students’ continuance usage intention of ChatGPT: amalgamation of the information system success model and the stimulus-organism-response paradigm. The International Journal of Information and Learning Technology, ahead-of-print(ahead-of-print). https://doi.org/10.1108/IJILT-01-2024-0006

    7. Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., . . . Wright, R. (2023). Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/https://doi.org/10.1016/j.ijinfomgt.2023.102642

    8. Essel, H. B., Vlachopoulos, D., Tachie-Menson, A., Johnson, E. E., & Baah, P. K. (2022). The impact of a virtual teaching assistant (chatbot) on students' learning in Ghanaian higher education. International Journal of Educational Technology in Higher Education, 19(1), 57. https://doi.org/10.1186/s41239-022-00362-6

    9. Firat, M. (2023). What ChatGPT means for universities: Perceptions of scholars and students. 6(1), 1-22. https://doi.org/10.37074/jalt.2023.6.1.22

    10. Fuchs, K. (2023). Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse? Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1166682

    11. Gamage, K., Dehideniya, S., Zhiheng, X., & Tang, X. (2023). ChatGPT and higher education assessments: More opportunities than concerns? Journal of Applied Learning & Teaching, 6(2), 358 – 369. https://doi.org/10.37074/jalt.2023.6.2.32

    12. Goel, A. (2020). AI-powered learning: Making education accessible, affordable, and achievable. ArXiv. https://doi.org/10.48550/arXiv.2006.01908

    13. Hack, K., & Knight, C. (2023). Higher education in the era of AI. AdvanceHE. https://www.advance-he.ac.uk/news-and-views/higher-education-era-ai

    14. Halamy, S., Kamarudin, N., & Kassim, N. H. (2024). Unveiling Perceptions of ChatGPT Usage among Information Science Students at UiTM Sarawak. International Journal of Advanced Research in Education and Society, 6(2), 886-899.

    15. Hsu, T., & Thompson, S. A. (2023, February 13). Disinformation researchers raise alarms about AI. Chatbots. The New York Times. https://www.nytimes.com/2023/02/08/technology/ai-chatbots-disinformation.html

    16. Huang, X. (2021). Aims for cultivating students’ key competencies based on artificial intelligence education in China. Education and Information Technologies, 26(5), 5127-5147. https://doi.org/10.1007/s10639-021-10530-2 Knox, J. (2020). Artificial intelligence and education in China. Learning, Media and Technology, 45, 1-14. https://doi.org/10.1080/17439884.2020.1754236

    17. Islam, I., & Islam, M. N. (2024). Exploring the opportunities and challenges of ChatGPT in academia. Discover Education, 3(1), 31. https://doi.org/10.1007/s44217-024-00114-w

    18. Karim, R. (2023, February 13). ChatGPT: Old AI problems in a new guise, new problems in disguise. Monash University. https://lens.monash.edu/@politics-society/2023/02/13/1385448/chatgpt-old-ai-problems-in-a-new-guise-new-problems-in-

    19. Kasneci, E. (2023, February 7). ChatGPT can lead to greater equity in education. MyScience. https://www.myscience.org/news/wire/chatgpt_can_lead_to_greater_equity_in_education-2023-tum

    20. Kerr, P. (2015). Adaptive learning. ELT Journal, 70(1), 88-93. https://doi.org/10.1093/elt/ccv055

    21. Lieberman, M. (2023). What is ChatGPT and how is it used in education? Education Week. https://www.edweek.org/technology/what-is-chatgpt-and-how-is-it-used-in-education/2023/01

    22. Lin, Z. (2023). Why and how to embrace AI such as ChatGPT in your academic life. Royal Society Open Science, 10(8), 230658. https://doi.org/10.1098/rsos.230658

    23. Lo, C. K. (2023). What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences, 13, 410. https://doi.org/10.3390/educsci13040410

    24. Lucy, L., & Bamman, D. (2021). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Gender and representation bias in GPT-3 generated stories. Proceedings of the Workshop on Narrative Understanding 3:48-55.

    25. Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology, 74(5), 570-581. https://doi.org/https://doi.org/10.1002/asi.24750

    26. McCallum, S. (2023). ChatGPT banned in Italy over privacy concerns. https://www.bbc.com/news/technology-65139406

    27. Megahed, F.M., Chen, Y.J., Ferris, J.A., Knoth, S., & Jones-Farmer, L.A. How Generative AI Models such as ChatGPT Can be (Mis)Used in SPC Practice, Education, and Research? An Exploratory Study. arXiv 2023, arXiv:2302.10916.

    28. Merriam, S. B. (1998). Qualitative research and case study applications in education. San Francisco: Jossey-Bass Publishers. Oxford: Routledge.

    29. Ngo, T. T. A. (2023). The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning (iJET), 18(17), pp. 4-19. https://doi.org/10.3991/ijet.v18i17.39019

    30. Opara, E., Theresa, A., & Tolorunleke, C. (2023). ChatGPT for Teaching, Learning and Research: Prospects and Challenges. 5, 33-40. https://doi.org/10.36348/gajhss.2023.v05i02.001

    31. Qadir, J. (2022). Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education. https://doi.org/10.36227/techrxiv.21789434

    32. Rasul, T., Nair, S., Kalendra, D., Robin, M., Santini, F., Ladeira, W., Sun, M., Day, I., Rather, A., & Heathcote, L. (2023). The Role of ChatGPT in Higher Education: Benefits, Challenges, and Future Research Directions. Journal of Applied Learning & Teaching, 6(1), 41 – 56. https://doi.org/10.37074/jalt.2023.6.1.29

    33. Rosenzweig-Ziff, D. (2023). New York City blocks use of the ChatGPT bot in its schools. https://www.washingtonpost.com/education/2023/01/05/nyc-schools-ban-chatgpt/.

    34. Sallam, M. (2023). The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations. medRxiv, 2023.2002.2019.23286155. https://doi.org/10.1101/2023.02.19.23286155

    35. Sharma, S., & Yadav, R. (2023). Chat GPT – A Technological Remedy or Challenge for Education System. Global Journal of Enterprise Information System, 14(4), 46-51. https://www.gjeis.com/index.php/GJEIS/article/view/698

    36. Sengupta, S., & Chakraborty, T. (2020). Use of chatbots in higher education: A study of student engagement and satisfaction. Education and Information Technologies, 25(6), 5147-5165. https://doi.org/10.1007/s10639-020-10171-x

    37. Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching, 6(1). Advance online publication. https://doi.org/10.37074/jalt.2023.6.1.17

    38. Yang, M. (2023, January 6). New York City schools ban AI chatbot that writes essays and answers prompts. The Guardian. https://www.theguardian.com/us news/2023/jan/06/new-york-city- schools-ban-ai-chatbot-chatgpt

    39. Yu, H. (2023). Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching [Opinion]. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1181712

    40. Zhai, X. (2023). ChatGPT User Experience: Implications for Education. https://dx.doi.org/10.2139/ssrn.4312418