Our publication about „AI-Powered Chatbots for Education Using RAGs“ got published right now.
Abstract:
This study examines the use of Retrieval-Augmented Generation (RAG) in AI-powered educational chatbots, focusing on embedding efficiency, large language model (LLM) performance, and context integrity. Implemented within the MOOC Informatik-Fit at TU Graz, the system supports scalable, curriculum-aligned self-paced learning. Three embedding models were evaluated, with text-embedding-ada-002 offering the best balance between semantic quality and cost-efficiency. Subsequently, three LLMs—GPT-3.5 Turbo, GPT-4o, and GPT-4o mini—were compared, revealing GPT-4o mini as the most cost-effective option while maintaining high accuracy and contextual coherence. Ethical robustness was assessed using 30 adversarial prompts, demonstrating strong resistance to jailbreaking in both GPT-4o and GPT-4o mini, supporting their suitability for secure and pedagogically reliable MOOC applications.
The paper also presents a replicable framework for the implementation of RAG-based systems, with the objective of promoting personalized, ethical, and accessible digital education on a large scale.
[article @ publisher’s homepage]
[draft @ ResearchGate]
Reference: Brünner, B., Deutschmann, F., Etzelstorfer, S., Lechner, A., Schön, S. & Ebner, M. (2029) “AI-Powered Chatbots for Education using RAGs: A Study on Embedding Efficiency, LLM Performance, and Context Integrity”. In: Transforming Education with Singularity Technologies: Lifelong Learning from Childhood to Adulthood (1st ed.). Uğur, S. (Ed.) Chapman and Hall/CRC. Chapter 9. 21 pages https://doi.org/10.1201/9781003584339
