Chatbot for University’s Students: Implementation and Evaluation
List of Authors
Hejab Al Fawareh, Keat Woon, Shaidah Jusoh
Keyword
Chatbot; Chatbot in Education; Chatbot Implementation; Chatbot User Experience
Abstract
Having a chatbot that can answer questions is increasingly indispensable in any educational institution, such as a university. This type of chatbot is essential to assist students in finding answers instantly and from any location. This paper demonstrates the development of a question-answering chatbot (QABot) for university students. The aim is to enhance the student experience by providing accessible and accurate information at their fingertips. The methodology of this study includes data collection from various sources, the development of a question-answering chatbot, testing and evaluation, and a user experience study. We deployed Azure Cognitive Services, specifically the Language Studio Custom Question Answering feature, for the development of the chatbot. Evaluation metrics were used to assess the chatbot’s performance, and a user experience study was conducted to explore students’ experience in using the QABot. This paper demonstrates a methodology of building and evaluating a kind of knowledge-based chatbots. The findings of this study suggest that Azure Cognitive Services is a good platform for creating a chatbot application and that students have a positive experience using the created chatbot. This study highlights the essential needs of a question-answering chatbot for university’s students, and details a framework for its design and assessment.