[publication] Exploring genAI Chatbots in MOOCs: Analyzing Student Interactions and Self-Regulated Learning Behaviors #imoox #tugraz #research

Our publication about „Exploring genAI Chatbots in MOOCs: Analyzing Student Interactions and Self-Regulated Learning Behaviors“ got published.

Abstract:
The integration of generative AI (genAI) chatbots into Massive Open Online Courses (MOOCs) presents new opportunities for supporting self-regulated learning (SRL). This study examines 1,302 chat-bot interactions from two Austrian blended MOOCs, where a retrieval-augmented generation (RAG) chatbot based on GPT 4o-mini was deployed to assist students. Using the process-action framework by Lai (2024), we categorize chatbot interactions into key SRL processes: defining , seeking, engaging, and reflecting. Results show that students predominantly use the chatbot for information retrieval, content summarization, and quiz-based reinforcement, with 41% of interactions classified as information search queries and 17% as rehearsal. However, engagement with metacognitive SRL strategies, such as goal setting and self-evaluation, remains low. Additionally, non-learning interactions, including humor-driven conversations, functional queries, and prompt injection attempts, showcase ways students interact with AI in educational settings. Based on our findings, we propose refinements to the existing SRL process-action framework, incorporating new categories to better account for genAI chatbot-specific interactions, such as Evaluation of Information Quality and Reformatting. We discuss implications for chat-bot integration in MOOCs, emphasizing AI-generated quizzes, structured feedback, and safeguards against misuse.

[article @ book’s homepage]
[draft @ ResearchGate]

Rerence: Brünner, B., Ebner, M., Schön, S. (2025). Exploring GenAI Chatbots in MOOCs: Analyzing Student Interactions and Self-regulated Learning Behaviors. In: Hamonic, E., Sharrock, R. (eds) Digital Education: Shaping Sustainable Lifelong Learning for All in the Era of AI. EMOOCS 2025. Lecture Notes in Computer Science, vol 15733. Springer, Cham. https://doi.org/10.1007/978-3-032-00056-9_2

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education using a Chatbot within a MOOC-platform (iMooX.at)

[bericht] Ergebnisse aus der Fallberatung im KI-Lab Münster: Acht potentielle Booster-Anwendungen für die Hochschulbildung #KI

In Rahmen des KI-Labs im Sommer 2025 in Münster haben wir rund um mögliche sinnvolle KI-Anwendungen in der Hochschullehre diskutiert und diese dann gesammelt:

Wie lassen sich KI-Technologien künftig sinnvoll in Lehr- und Prüfungsprozesse einbinden?
Diese Frage stand im Mittelpunkt des ersten KI-Labs des HFD, das im Juli 2025 in Münster stattfand. Über 40 Expert:innen und Entscheider:innen aus Hochschulen, die sich strategisch mit dem Einsatz von Künstlicher Intelligenz befassen, arbeiteten dort gemeinsam an praxisnahen Lösungen. Martin Ebner und Sandra Schön von der TU Graz berichten, welche Ideen für KI-gestützte Lehr- und Lernanwendungen sie mit ihren Kolleginnen und Kollegen von anderen Hochschulen entwickelt haben. 

Zusammenfassend ist daraus dieser Bericht entstanden der jetzt vom Hochschulforum Digitalisierung veröffentlicht wurde: [Link zum Bericht]

[publication] Ensuring Quality in AI-Generated Multiple-Choice Questions for Higher Education with the QUEST Framework #AI #tugraz #research

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education.

Another research paper about the use of AI for education – titled „Ensuring Quality in AI-Generated Multiple-Choice Questions for Higher Education with the QUEST Framework“ – was published.

Abstract:
With the rise of generative AI models, such as large language models (LLMs), in educational settings, there is a growing demand to ensure the quality of AI-generated multiple-choice questions (MCQs) used in higher education. Traditional quiz development methods fall short in addressing the unique challenges posed by AI-generated content, such as consistency, cognitive demand, and question uniqueness. This paper presents the QUEST framework, a structured approach designed specifically to evaluate the quality of LLM-generated MCQs across five dimensions: Quality, Uniqueness, Effort, Structure, and Transparency. Following an iterative research process, AI-generated questions were assessed and refined using QUEST, revealing that the framework effectively improves question clarity, relevance, and educational value. The findings suggest that QUEST is a viable tool for educators to maintain high-quality standards in AI-generated assessments, ensuring these resources meet the pedagogical needs of diverse learners in higher education.

[draft @ ResearchGate]
[full article @ publisher’s website]

Reference: Ebner, M., Brünner, B., Forjan, N., Schön, S. (2025). Ensuring Quality in AI-Generated Multiple-Choice Questions for Higher Education with the QUEST Framework. In: Tomczyk, Ł. (eds) New Media Pedagogy: Research Trends, Methodological Challenges, and Successful Implementations. NMP 2024. Communications in Computer and Information Science, vol 2537. Springer, Cham. https://doi.org/10.1007/978-3-031-95627-0_20

[publication] aicast: Combining AI-Generated and Instructor-Defined Content in Educational Podcasts #research #tugraz

At this year’s ED-Media conference, we introduced a new AI-based concept for educational podcasts: „aicast: Combining AI-Generated and Instructor-Defined Content in Educational Podcasts„.

Abstract:
Generative AI is transforming educational content. In this poster, we present aicast.fyi, an open-source platform for producing personalized educational podcasts that combine AI-generated and instructor-defined content. Each track contains dynamic and fixed segments. Instructors define guiding questions during track design, ensuring alignment with learning objectives. This hybrid approach addresses concerns about maintaining instructional integrity with automation and personalization. The poster provides an architectural overview and demonstrates how the system integrates text generation and voice synthesis to produce audio-based learning experiences. Instructional designers must play an active role in shaping AI-assisted educational tools. This poster invites educators, designers, and researchers to engage with aicast and collaborate on developing high-quality, responsible, and learner-centered audio content. By allowing learners to control content sequences and personalize segments based on their own inputs, aicast.fyi also supports self-regulated learning (SRL), empowering users to take ownership of their educational journey.

[draft @ ResearchGate]
[full article @ conference website]

Reference: Brünner, B., Leitner, P., Geier, G. & Ebner, M. (2025). aicast: Combining AI-Generated and Instructor-Defined Content in Educational Podcasts. In T. Bastiaens (Ed.), Proceedings of EdMedia + Innovate Learning (pp. 148-152). Barcelona, Spain: Association for the Advancement of Computing in Education (AACE). Retrieved June 4, 2025 from https://www.learntechlib.org/primary/p/226139/

[presentation] Synthetic Educators: Analyzing AI-Driven Avatars in Digital Learning Environments #HCII25

Our research about AI-Driven Avatars was presented at 27th International Conference on Human-Computer Interaction, Gothenburg, Sweden.

Struger, P., Brünner, B., & Ebner, M. (2025, Juni 23). Presentation: Synthetic Educators: Analyzing AI-Driven Avatars in Digital Learning Environments. Graz University of Technology. https://doi.org/10.3217/bngt5-p2053

[publication] Workshop for Special Interest Group Emerging Technologies for Learning and Teaching: Exploring Educational Podcasts with AI #tugraz #research

We also did workshops at this year’s ED-Media conference. One of them was titled „Workshop for Special Interest Group Emerging Technologies for Learning and Teaching: Exploring Educational Podcasts with AI“ and followed the idea of open discussions.

Abstract:
How can educators unleash the power of AI without losing control over core educational strategies? In this workshop, we introduced aicast, an open-source platform for educational podcasts that combines the best of both worlds: AI-generated elements for personalization and flexibility, and fixed elements, with instructor-defined content to ensure pedagogical accuracy. This hybrid approach reduces the risks associated with AI-generated materials like hallucinations. Attendees experienced how the platform utilizes LLMs like ChatGPT for personalized content authoring and ElevenLabs for high-quality voice synthesis, enabling real-time creation of educational audio content. After a short demo and hands-on session, participants engaged in a guided discussion: What is the core of an educational podcast? Most importantly from the perspective of an instructional designer, how must an educational podcast be? This session was part of the Special Interest Group on Emerging Technologies for Learning and Teaching at the ED-Media 2025 conference.

[draft @ ResearchGate]
[full article @ conference website]

Reference: Ebner, M. & Brünner, B. (2025). Workshop for Special Interest Group Emerging Technologies for Learning and Teaching: Exploring Educational Podcasts with AI. In T. Bastiaens (Ed.), Proceedings of EdMedia + Innovate Learning (pp. 1375-1376). Barcelona, Spain: Association for the Advancement of Computing in Education (AACE). Retrieved June 4, 2025 from https://www.learntechlib.org/primary/p/226347/.

[video] Digitale Bildung #avatar #ki #tugraz

Wir haben wieder etwas mit „meinem“ Avatar herumgespielt und ein Video erstellt rund um das Thema „Digitale Bildung“. Das gibt es nun in zwei Versionen – deutsch und englisch. Vielleicht ist es ja auch in anderen Kontexten hilfreich, freu mich wie immer auf Rückmeldungen.

YouTube

Mit dem Laden des Videos akzeptieren Sie die Datenschutzerklärung von YouTube.
Mehr erfahren

Video laden

Version in deutscher Sprache
YouTube

Mit dem Laden des Videos akzeptieren Sie die Datenschutzerklärung von YouTube.
Mehr erfahren

Video laden

Version in englischer Sprache