[publication] Development and Evaluation of an AI-Supported Teacher Assistant Tool (AI-TAT) to Foster Self-Regulated Learning #tugraz #AIinEducationa

Our publication titled „Development and Evaluation of an AI-Supported Teacher Assistant Tool (AI-TAT) to Foster Self-Regulated Learning“ has been published.

Abstract:
Self-regulated learning (SRL) is increasingly recognised as a key competence for students, yet many teachers struggle to integrate SRL concepts into concrete classroom materials like worksheets. In this paper, SRLly is presented, an AI-supported teacher assistance tool (AI-TAT) that helps teachers revise existing worksheets to better scaffold SRL processes. Rather than submitting entire documents to a large language model (LLM), SRLly performs local preprocessing of uploaded PDFs to extract text with positional metadata, segments the worksheet into meaningful blocks, and sends only relevant blocks for analysis. Based on this structured representation, the system generates actionable recommendations aligned with four SRL dimensions (planning, strategy, monitoring, reflection). Recommendations are presented in an easy-to-use interface that supports teachers’ workflows by providing short rationales and concrete recommendations with ready-to-use text snippets that can be copied. We conducted an initial evaluation during a teacher professional development training with 30 teachers at an Austrian school (student age range 10–18). Overall perceptions were positive: 76% of participants rated SRLly as good or very good. Likert-scale results indicated high perceived usefulness and feasibility, while trustworthiness ratings were more mixed, highlighting reliability of AI output as a key area for improvement. Our findings suggest that structured, material-centred AI feedback can support teachers in integrating SRL into everyday worksheet design, while underscoring the need for stronger reliability and real-world validation.

[full article @ publisher’s homepage]
[draft @ ResearchGate]

Reference: Geier, G., Ebner, M., Burgsteiner, H. (2026). Development and Evaluation of an AI-Supported Teacher Assistant Tool (AI-TAT) to Foster Self-Regulated Learning. In: Smith, B.K., Borge, M. (eds) Learning and Collaboration Technologies. HCII 2026. Lecture Notes in Computer Science, vol 16733. Springer, Cham. https://doi.org/10.1007/978-3-032-30784-2_12

[publication] On Using an LLM-Based Approach for Automatic Evaluation of Programming Tasks in MOOC Videos #tugraz #AIinEducation

Our publication about „On Using an LLM-Based Approach for Automatic Evaluation of Programming Tasks in MOOC Videos“ has been published.

Abstract:
Interactive videos promote learner engagement by transforming the passive activity of watching videos into an active learning process. LIVE, a web platform developed in previous research that allows for the integration of interactive elements into videos, also supports embedding programming tasks. However, at the beginning of our research, the output of the submitted solution was automatically compared to the reference output, but the code itself still had to be checked manually, as no automatic process was available to verify the solution and provide feedback. To address this, a stand-alone application was developed that automatically evaluates students’ solutions to Python programming tasks using a self-hosted large language model. This application was then integrated into the existing platform. To test this approach, a massive open online course containing four interactive videos with several programming tasks and quizzes was created. Students’ performance was analyzed using quiz results, task submissions, self-assessments, and user statistics provided by the course platform and LIVE. The results indicate that utilizing a large language model for automated feedback can positively impact learning outcomes. However, some limitations must be taken into account, such as the need to correct some of the model’s generated outputs manually due to insufficient feedback quality for certain tasks. This suggests that the combination of automated and manual evaluation seems to be the most effective approach for now.

[full article @ publisher’s homepage]
[draft @ ResearchGate]

Reference: Kindlhofer, C., Wachtler, J., Ebner, M. (2026). On Using an LLM-Based Approach for Automatic Evaluation of Programming Tasks in MOOC Videos. In: Smith, B.K., Borge, M. (eds) Learning and Collaboration Technologies. HCII 2026. Lecture Notes in Computer Science, vol 16733. Springer, Cham. https://doi.org/10.1007/978-3-032-30784-2_13

[publication] Code Meets Career: Employer Interpretations of Coding Bootcamp Graduates in Austria and Germany #edmedia

We are happy about another publication at this year’s edmedia conference titled „Code Meets Career: Employer Interpretations of Coding Bootcamp Graduates in Austria and Germany

Abstract:
Coding bootcamps have expanded rapidly in response to skill shortages in the IT sector and as alternative pathways into the field. However, little is known about how these pathways are perceived and valued within organizations, especially in Austria and Germany. This study therefore examines how companies in Austria and Germany perceive, evaluate, and integrate coding bootcamp graduates. Drawing on a qualitative content analysis of five semi-structured interviews with decision-makers in software development, IT consulting, and human resources, the study focuses on socially situated employer perspectives on skills, potential, and legitimacy. The findings reveal a nuanced picture: while graduates are generally valued for their motivation, adaptability, learning orientation, teamwork, and practical engagement, concerns persist regarding theoretical depth, project experience, and formal recognition. In the case of refugee participants, language proficiency emerged as an additional challenge shaping labor market integration. The findings further suggest that workplace integration depends less on the bootcamp model itself than on organizational conditions such as onboarding structures, mentoring opportunities, and continued professional development. Overall, the study provides exploratory insights into how coding bootcamp qualifications are interpreted and evaluated by employers and contributes to alternative educational pathways into software development careers.

[article @ conference homepage]
[draft @ ResearchGate]

Reference: Wolf, D., Ebner, M. & Brünner, B. (2026). Code Meets Career: Employer Interpretations of Coding Bootcamp Graduates in Austria and Germany. In Proceedings of EdMedia 2026 Edinburgh (pp. 1170-1184). Edinburgh, Scotland: Association for the Advancement of Computing in Education (AACE). Retrieved July 1, 2026 from https://www.learntechlib.org/primary/p/2129750/.

[publication] How Embodiment Changes AI Tutoring: Comparing Student Perceptions of Text and AI Human Avatar-Based Chatbot Systems #AIinEducation #chatbot #tugraz

Our publication titled „How Embodiment Changes AI Tutoring: Comparing Student Perceptions of Text and AI Human Avatar-Based Chatbot Systems“ is now published.

Abstract:
Embodied conversational interfaces are able to deliver generative AI tutoring via synthesised speech and human-like video avatars. However, there is limited empirical evidence on how embodiment shapes the learner experience and self-regulated learning (SRL). This study compares the perceptions of students interacting with a text-based Retrieval-Augmented Generation (RAG) tutor and an avatar-based RAG tutor in two authentic higher education contexts (introductory computer science and Python programming) across two European universities. Adopting a Design-Based Research approach, we collected (1) questionnaire data from users and non-users, and (2) anonymised interaction logs comprising 341 user messages, which were coded using an SRL process–action framework. The results show that the perceived level of learning support is largely consistent with previous text-only deployments: the tutor is primarily valued for providing explanations and support related to practice, while motivational support is still comparatively weak. However, embodiment notably improves perceptions of the system as a communication partner, with active users rating this dimension more positively than non-users. Modality ratings suggest that audio output is perceived as more helpful than the visual avatar. Log analyses show that interactions are still dominated by information-seeking (Seeking–Search) and that metacognitive SRL actions (e.g. goal setting and self-evaluation) are rare. Embodiment also introduces additional peripheral interactions (e.g. character-focused prompts and human-likeness checks), thereby increasing the proportion of non-learning dialogue. Overall, the findings suggest that, while embodiment enhances social presence, it does not automatically foster deeper SRL. Explicit pedagogical scaffolding is needed to encourage learners to engage in metacognitive regulation.

[full paper @ publisher’s homepage]
[draft @ ResearchGate]

Reference: Brünner, B., Nestler, M., Pucher, L., Ebner, M. (2026). How Embodiment Changes AI Tutoring: Comparing Student Perceptions of Text and AI Human Avatar-Based Chatbot Systems. In: Smith, B.K., Borge, M. (eds) Learning and Collaboration Technologies. HCII 2026. Lecture Notes in Computer Science, vol 16731. Springer, Cham. https://doi.org/10.1007/978-3-032-30542-8_25

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education, Chatbots and MOOCs.

[blogpost] Generative KI in der Hochschullehre – Wie wir Innovation verantwortungsvoll gestalten #hfd #tugraz #AI

Wir haben einen kurzen Blogpost über „Generative KI in der Hochschullehre – Wie wir Innovation verantwortungsvoll gestalten,“ beim Hochschulforum Digitalisierung verfasst um auch auf unsere Whitepaper hinzuweisen:

Dieser Blogbeitrag von Philipp Leitner, Benedikt Brünner, Martin Ebner und Sandra Schön bietet Hochschulen eine kompakte Anleitung, wie sie generative KI überlegt in der Lehre einsetzen können. Die Tipps wurden aus der Praxis an der TU Graz entwickelt und getestet und werden ergänzt mit Beispielen sowie Hinweisen auf nützliche Tools.

[Link zum Blogpost]

Whitepaper: Schön, S., Brünner, B., Ebner, M., & Leitner, P. (2026). Evaluating GenAI Innovation in Higher Education. A Whitepaper (Version 1.0 – May 22, 2026). Graz University of Technology. https://doi.org/10.3217/1tfkj-ntj85


[publication] Empowering Preservice Biology Teachers as Designers of Pedagogical AI Agents: Moving Beyond Data Feeding toward Pedagogical Design #research

Our article about „Empowering Preservice Biology Teachers as Designers of Pedagogical AI Agents: Moving Beyond Data Feeding toward Pedagogical Design“ is published and available online.

Abstract:
Artificial intelligence (AI) influences learning processes, student activities, and the organization of teaching, both in general and specifically in science education. Research indicates that the way AI will affect science learning primarily depends on how it is implemented in teaching. This study examines the ability of preservice biology teachers (PSBTs) to independently develop pedagogical AI agents (TDP-AI agents), most often in the form of chatbots, tailored to teaching goals, content, and students‘ needs. This empirical study, based on a mixed-methods research approach and applying the ICAP theoretical framework, analyzed 54 lesson plans. In addition, the study explored PSBTs‘ perceptions regarding the development and contribution of TDP-AI to biology teaching. The results reveal three patterns of AI agent application in lesson plans: (a) intensive use of TDP-AI agents across all lesson phases, promoting students‘ cognitive engagement, (b) moderate and selective use focused on core activities, and (c) limited use mainly in introductory segments. Five thematic areas reflect PSBTs‘ perspectives: (1) personalization and flexibility of learning, (2) enhancement of student motivation and engagement, (3) development of teachers‘ digital and pedagogical competencies, (4) technical and resource-related challenges in agent development, and (5) pedagogical-methodological barriers in designing student-AI interactions. The findings emphasize the need for systematic support for pre-service teachers in developing digital tools and building pedagogical approaches to ensure AI is used ethically and effectively in science education.

[full article @ publisher’s homepage]
[full article @ ResearchGate]

Reference: Anđić, B., Helm, C., Weinhandl, R. et al. Empowering Preservice Biology Teachers as Designers of Pedagogical AI Agents: Moving Beyond Data Feeding toward Pedagogical Design. Res Sci Educ (2026). https://doi.org/10.1007/s11165-026-10359-0

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education.

[mooc] Informatik-FIT #tugraz #brückenkurs

Fast schon traditionell, darf ich den Start des MOOC „Informatik-FIT“ verkünden, welcher vor allem unseren Studienanfänger:innen helfen soll, den Einstieg in die Informatik zu erleichtern:

Die Vielfalt der Probleme, die in der Informatik behandelt werden, macht eine kurze und dennoch vollständige Definition dessen, was Informatik ist, unmöglich.
Unmöglich ist es auch, alle Themen in einem Einführungskurs unterzubringen.
Irgendwo müssen wir aber trotzdem anfangen und so haben wir versucht, die wichtigsten Grundbegriffe und Ideen der Informatik auszuwählen und diese so zu vermitteln, dass sich die Teilnehmer:innen schnell ein breiteres Bild von der Informatik machen können.
Darüber hinaus soll es für die Teilnehmer:innen möglich sein, Zusammenhänge zwischen den einzelnen Themen zu erkennen bzw. herzustellen. 

Der Trailer zum MOOC:

YouTube

Mit dem Laden des Videos akzeptieren Sie die Datenschutzerklärung von YouTube.
Mehr erfahren

Video laden

Die Teilnahme ist natürlich wie immer kostenfrei: [Link zur Anmeldung zum MOOC]

[mooc] Level-Up: Ein Blick in die Informatik #imoox #tugraz #informatik #schule

Die TU Graz bietet einen Online-Kurs für Schülerinnen und Schüler an, mit dem Titel „Level-Up: Ein Blick in die Informatik„. Damit soll ein wenig Einblick in die Informatik gegeben werden:

Dieser Kurs bietet einen leicht zugänglichen Einstieg in die Informatik, Programmierung und Künstliche Intelligenz.
Die Teilnehmenden lernen, wie digitale Technologien funktionieren, und sammeln praktische Erfahrungen mit grundlegenden Programmierkonzepten in Python.
Der Kurs unterstützt Schülerinnen und Schüler dabei, fundierte Entscheidungen für zukünftige technische Studienrichtungen zu treffen.

Der Kurs ist natürlich kostenlos: [Link zur kostenlosen Anmeldung]

[mooc] Grundbegriffe der Mechanik für technische Anwendungen #imoox #leoben #MINT #tuaustria

Aus einer ehemaligen Initiative der TU Austria ist der MOOC der Montanuniversität Leoben zu „Grundbegriffe der Mechanik für technische Anwendungen“ entstanden und wird nun schon fast traditionell jedes Jahr angeboten:

Das Fach „Mechanik“ bildet eine der zentralen Säulen ingenieurwissenschaftlicher Studien. Der Kurs richtet sich an angehende Absolventen allgemeinbildender oder berufsbildender Schulen, die vor der Entscheidung für ein Studium stehen. Anhand eines einfachen Beispiels aus der Technik sollen die erste Einblicke in die Terminologie des Fachs vermittelt werden. Darüber hinaus sollen die Kursteilnehmer die Herangehensweise des Ingenieurs an praxisrelevante technisch-naturwissenschaftliche Fragestellungen kennenlernen.

Der Kurs ist natürlich kostenlos: [Kostenlose Registrierung zum Online-Kurs]

[mooc] Selbstorganisiert im Studium #imoox #tugraz #SOS

Die TU Graz bietet wiederum zu Semesterstart den MOOC zu „SOS – Selbstorganisiert im Studium“ an, mit der Idee unsere Studienanfänger:innen mit wichtigen Informationen rund um den Studienstart zu versehen. Dabei ,geht es aber nicht nur um organisatorische Hinweise, sondern vielmehr um wichtige Themen fürs Studium – damit wir jedenfalls eines verhindern: Laut SOS schreien 🙂

Liebe Studienanfänger*in, liebe*r Studieninteressierte*r!
Du stehst am Anfang deines Studiums oder überlegst dir, in Zukunft zu studieren zu beginnen. Möglicherweise hast du auch schon ein, zwei Semester hinter dir, doch es sind noch viele Fragen offen. Mit dem Studienstart beginnt ein neuer Lebensabschnitt, der neue Herausforderungen mit sich bringen kann. Vielleicht denkst du dir zwischenzeitlich: SOS!
Dieser MOOC (Massive Open Online Course) bietet dir eine gezielte Hilfestellung, damit du top vorbereitet in dein Studium startest. Einige Inhalte sind spezifisch für Studienanfänger*innen der TU Graz ausgelegt, andere sind ganz allgemein gehalten und richten sich an alle Studienanfänger*innen.
Der Kurs, entstanden unter Mitwirkung von Studierenden, Lehrenden, Expert*innen zu den jeweiligen Themenbereichen und der Hochschüler*innenschaft der TU Graz, soll eine Ergänzung zu bestehenden Angeboten wie den Welcome Days, Erstsemestrigentutorien etc. sein und diese nicht ersetzen. Die Inhalte helfen dir, dich rund um den Studienstart mit einigen Grundlagen vertraut zu machen. Du kannst sie natürlich zu jedem beliebigen Zeitpunkt nachhören oder nachlesen und sie als Nachschlagewerk für den Studienstart nutzen, wenn du mal nicht weiter weißt.

Wie immer ist der Online-Kurs völlig kostenfrei: [Anmeldung zum kostenlosen Online-Kurs]