TY - JOUR
T1 - ChatGMP
T2 - A case of AI chatbots in chemical engineering education towards the automation of repetitive tasks
AU - Caccavale, Fiammetta
AU - Gargalo, Carina L.
AU - Kager, Julian
AU - Larsen, Steen
AU - Gernaey, Krist V.
AU - Krühne, Ulrich
N1 - Publisher Copyright:
© 2024 The Authors
PY - 2025
Y1 - 2025
N2 - Artificial Intelligence (AI) is rapidly and consistently becoming more integrated in various aspects of our lives. One of the areas where these systems are increasingly used is education. In fact, it is both being incorporated into specific curricula, allowing students the possibility to acquire skills within this field, and more recently AI has been used as a tool to facilitate the teaching and learning process. However, an increased demand and availability of these tools do not imply a successful switch from traditional to AI-supported learning. In this work, ChatGMP, a chatbot leveraging a Large Language Model (LLM) able to conduct an interview exercise in a Master's Degree course taught at the Technical University of Denmark (DTU), is introduced. The exercise consists in a student interview of a fictitious company, represented by the teachers or ChatGMP, regarding its Good Manufacturing Practices (GMP). The aim is for the students to ask sensible and well-reasoned questions to acquire the necessary documentation to make an exhaustive report indicating whether the company is a potential fit for business. To evaluate the initiative, we compare the performance of ChatGMP to the one of the physical teachers of the course, as well as the perception of the students towards it. The results show no significant difference in the information provided by the teachers and the model, enabling the students to achieve similar learning. The students that interacted with ChatGMP are satisfied with the initiative and would likely recommend future students to perform the audit with the digital tool. This initial experiment and its positive results lay the foundation for opening the discussion on how to use LLMs in education, the opportunities they could provide, as well as their limitations and drawbacks.
AB - Artificial Intelligence (AI) is rapidly and consistently becoming more integrated in various aspects of our lives. One of the areas where these systems are increasingly used is education. In fact, it is both being incorporated into specific curricula, allowing students the possibility to acquire skills within this field, and more recently AI has been used as a tool to facilitate the teaching and learning process. However, an increased demand and availability of these tools do not imply a successful switch from traditional to AI-supported learning. In this work, ChatGMP, a chatbot leveraging a Large Language Model (LLM) able to conduct an interview exercise in a Master's Degree course taught at the Technical University of Denmark (DTU), is introduced. The exercise consists in a student interview of a fictitious company, represented by the teachers or ChatGMP, regarding its Good Manufacturing Practices (GMP). The aim is for the students to ask sensible and well-reasoned questions to acquire the necessary documentation to make an exhaustive report indicating whether the company is a potential fit for business. To evaluate the initiative, we compare the performance of ChatGMP to the one of the physical teachers of the course, as well as the perception of the students towards it. The results show no significant difference in the information provided by the teachers and the model, enabling the students to achieve similar learning. The students that interacted with ChatGMP are satisfied with the initiative and would likely recommend future students to perform the audit with the digital tool. This initial experiment and its positive results lay the foundation for opening the discussion on how to use LLMs in education, the opportunities they could provide, as well as their limitations and drawbacks.
KW - Artificial Intelligence
KW - Chatbots in education
KW - Education 4.0
KW - Higher education
KW - Large Language Models
KW - Prompt engineering
U2 - 10.1016/j.caeai.2024.100354
DO - 10.1016/j.caeai.2024.100354
M3 - Journal article
AN - SCOPUS:85214313775
SN - 2666-920X
VL - 8
JO - Computers and Education: Artificial Intelligence
JF - Computers and Education: Artificial Intelligence
M1 - 100354
ER -