Abbas, N orcid.org/0000-0002-1434-6497, Pickard, T, Atwell, E orcid.org/0000-0001-9395-3764 et al. (1 more author) (2021) University Student Surveys Using Chatbots: Artificial Intelligence Conversational Agents. In: Learning and Collaboration Technologies: Games and Virtual Environments for Learning. HCI International 2021, 24-29 Jul 2021, Washington DC, USA. Lecture Notes in Computer Science, 12785 . Springer, Cham , pp. 155-169. ISBN 978-3-030-77942-9
Abstract
Predefined web surveys are often used to collect course evaluations from students in higher education institutions. These institutions use the evaluations to adjust their courses’ pedagogical standards and lecture style to cope with an increasingly uncertain and complex world. Many limitations to using web surveys have been reported such as low response rates and low-quality responses to open questions. To overcome these limitations, artificial intelligence conversational agents (CAs) or ‘chatbots’ are used to play the interviewer role, facilitating the enhancement of the quality of responses. This is accomplished by mimicking human-human conversations; by asking questions in a friendly, casual way and pursuing high-quality responses. This study aims to explore the opportunities and the obstacles of using CAs in collecting course evaluations in three European universities (UK, Spain and Croatia) and one Centre of excellence in Cyprus. The transcripts collected have been analyzed using statistical data analysis methods and qualitative data analysis techniques. Our findings reveal that the use of CAs in collecting course feedback from students has a positive impact on response quality and can boost students’ enjoyment levels. Furthermore, gender differences and student age have been identified as important factors that can influence the depth of the conversation with the CA.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © Springer Nature Switzerland AG 2021. This is an author produced version of a conference paper published in Lecture Notes in Computer Science. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Chatbot; Conversational agent; Online course evaluation; Pedagogical conversational agents; Student enjoyment |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) The University of Leeds > Faculty of Education, Social Sciences and Law (Leeds) > School of Education (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 16 Feb 2021 11:39 |
Last Modified: | 06 Dec 2024 17:09 |
Status: | Published |
Publisher: | Springer, Cham |
Series Name: | Lecture Notes in Computer Science |
Identification Number: | 10.1007/978-3-030-77943-6_10 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:171076 |