Schlagwort: research

Veröffentlicht am

[publication] Whitepaper on Evaluating GenAI Innovation in Higher Education #tugraz #research #AIinEducation

Our publication, „Whitepaper on Evaluating GenAI Innovation in Higher Education,“ is included in the proceedings of the EDMedia 2026 conference.

Abstract:
Generative artificial intelligence (genAI) is increasingly shaping higher education by enabling new forms of content creation, assessment, learner support, personalization, and synthetic media. However, its value cannot be determined solely by technical performance, novelty, or efficiency. This paper presents an evaluation framework for quality genAI applications in higher education. This paper presents a practice-derived framework developed through a cross-case synthesis of nine diverse GenAI implementations at Graz University of Technology. Analyzing projects ranging from AI-generated content to RAG-based chatbots, we identified recurring decision points and risk patterns to formulate a five-phase, non-linear evaluation model. The framework guides institutions through specifying context, assessing feasibility, selecting implementation strategies, conducting multi-layered pilots, and performing data-informed analysis. A defining feature is the integration of explicit „Sustain-or-Discontinue“ decision gates at each stage, ensuring resources are committed only to viable applications while providing a structured pathway to terminate initiatives that fail to meet pedagogical or ethical standards. We argue that the core institutional capability lies not in rapid adoption, but in the discipline to evaluate responsibly, balancing experimentation with the rigor to govern and discontinue when necessary.

[publication @ conference’s homepage]
[preview @ ResearchGate]

Reference: Schön, S., Brünner, B., Ebner, M. & Leitner, P. (2026). Whitepaper on Evaluating GenAI Innovation in Higher Education. In Proceedings of EdMedia 2026 Edinburgh (pp. 697-703). Waynesville, NC: Association for the Advancement of Computing in Education (AACE). Retrieved June 15, 2026 from https://www.learntechlib.org/primary/p/2129693/.

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education.

Veröffentlicht am

[issue] Applications of Digital Technology and AI in Educational Settings #tugraz #research

I am happy to announce that my successful journal issue on „Applications of Digital Technology and AI in Educational Settings“ is now closed. In summary, 16 very interesting articles are part of it:

  • Generative AI as a More Knowledgeable Other: An Autoethnographic Study of Game Design Education
  • An Exploratory Study of a Generative AI-Based Intelligent Tutoring System Using a Multi-Agent Architecture in Higher Education
  • Design Principles and Impact of a Learning Analytics Dashboard: Evidence from a Randomized MOOC Experiment
  • Retrieval-Augmented Vision–Language Agents for Child-Centered Encyclopedia Learning
  • A Multi-Agent Chatbot Architecture for AI-Driven Language Learning
  • Memory-Augmented Large Language Model for Enhanced Chatbot Services in University Learning Management Systems
  • PCcGE: Personalized Chinese Couplet Generation and Evaluation Framework Based on Large Language Models
  • Gen-SynDi: Leveraging Knowledge-Guided Generative AI for Dual Education of Syndrome Differentiation and Disease Diagnosis
  • Students’ Perceptions of AI Digital Assistants (AIDAs): Should Institutions Invest in Their Own AIDAs?
  • Digital Human Technology in E-Learning: Custom Content Solutions
  • Automatic Correction System for Learning Activities in Remote-Access Laboratories in the Mechatronics Area
  • Toward Questionnaire Complexity Reduction by Decreasing the Questions
  • Gamification and Immersive Experiences: A Gamified Approach for Promoting Active Aging
  • AI-Driven Smart Transformation in Physical Education: Current Trends and Future Research Directions
  • Regional Perspectives on Service Learning and Implementation Barriers: A Systematic Review
  • An Overview of Commercial Virtual Reality Providers in Education: Mapping the Current Market Landscape

You can find the whole issue here [Link to the Open-Access-Issue]

Veröffentlicht am

[publication] The OER Paradox in Ukraine: Legal Comfort and Its Impact on Open Educational Practices #OER #research

Our publication about „The OER Paradox in Ukraine: Legal Comfort and Its Impact on Open Educational Practices“ is published in the conference proceedings of this year’s EDMedia conference.

Abstract:
This study analyses the impact of the new Law of Ukraine „On Copyright and Related Rights“ (2811-IX) on the use of educational materials in the context of digital transformation and military crisis. Using the benchmarking methodology „15 cases in 15 countries“ and qualitative interviews with teachers, the work compares Ukrainian norms with the practice of European countries. The results show that broad educational exceptions (in particular, Articles 22 and 24) create a situation of „legal comfort“ for the academic community, allowing the legal use of protected content in closed digital environments. However, this gives rise to the „OER paradox“: the absence of legal barriers to the use of proprietary resources reduces the motivation to create full-fledged open educational resources under open licenses. The paper highlights the need for institutional incentives to overcome dependence on closed content and integrate Ukraine into the global open education movement.

[publication @ conference’s homepage]
[preview @ ResearchGate]

Reference: Andriichenko, Y., Ebner, M., Schön, S. & Brünner, B. (2026). The OER Paradox in Ukraine: Legal Comfort and Its Impact on Open Educational Practices. In Proceedings of EdMedia 2026 Edinburgh (pp. 1589-1599). Waynesville, NC: Association for the Advancement of Computing in Education (AACE). Retrieved June 15, 2026 from https://www.learntechlib.org/primary/p/2129797/.

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of Open Educational Resources (OER).

Veröffentlicht am

[publication] Sieben Mythen der KI-Nutzung #tugraz

Unser Beitrag zu „Sieben Mythen der KI-Nutzung“ hat viele Reaktionen hervorgerufen und nun wurde er auch in die Zeitschrift „Die Österreichische Volkshochschule“ aufgenommen.

Abstract:
Wer das Internet nutzt, kommt im Frühjahr 2026 nicht um Anwendungen generativer Künstlicher Intelligenz (kurz KI) herum. Suchmaschinen bieten neben Links standardmäßig KI-generierte Antworten an, Chatbots unterstützen bei der Buchung von Websites, Schüler:innen lassen sich Tests passend zu den Arbeitsblättern der Lehrer:innen generieren usw. – Doch nicht alles, was uns die KI-Anwendungen liefern, wie wir sie nutzen und ihre Ergebnisse verstehen, ist zutreffend und unproblematisch. Das liegt auch an Missverständnissen darüber, wie KI-Anwendungen funktionieren. Aus unserer Sicht – es gibt dazu noch keine empirische Evidenz – verdienen folgende sieben Aussagen besondere Aufmerksamkeit, insbesondere auch im Kontext von Bildung, Schule und Hochschule:

  1.  KI-Anwendungen sind neutral, objektiv und vorurteilsfrei
  2.  KI-Anwendungen arbeiten logisch
  3. KI-Anwendungen denken und lernen wie Menschen
  4. KI-Anwendungen sind empathisch
  5. KI-Anwendungen sind ökologisch und sozial problemlos
  6. KI-Nutzung ist rechtlich einwandfrei
  7. KI-Anwendungen machen Wissen und Kompetenzentwicklung überflüssig

In diesem Beitrag möchten wir diese als „Mythen“ bezeichneten Aussagen beschreiben und aufzeigen, dass und warum sie nicht zutreffend sind. Damit möchten wir einen zukünftig fundierten Umgang und durch die Beschreibung von KI-Mythen Forschung dazu initiieren und unterstützen. 

Referenz: Schön, S., Brünner, B., Ebner, M., Diesenreither, S., Hanfstingl, B., Krammer, G (2026) Sieben Mythen der KI-Nutzung. Die Österreichische Volkshochschule. Jg. 2026 / 286. [Link]

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education.

Veröffentlicht am

[publication] Generative AI Chatbots in Secondary Mathematics Education: Development and Implementation of a Dynamic Large Language Model-Based Learning Assistant for Quadrilaterals #tugraz

Our contribution titled „Generative AI Chatbots in Secondary Mathematics Education: Development and Implementation of a Dynamic Large Language Model-Based Learning Assistant for Quadrilaterals“ is now published.

Abstract:
As artificial intelligence becomes more and more a part of education, the challenge is not about having access to generative tools, but about connecting them with the goals of the curriculum and the needs of the classroom. This chapter presents the design and evaluation of a large language model–based chatbot developed specifically for teaching quadrilaterals in lower secondary mathematics. The chatbot integrates fine-tuning with retrieval-augmented generation (RAG), combining accurate, curriculum-aligned content with flexible, conversational support. The chatbot allows learners to ask conceptual questions, solve problems step by step, receive guided hints, and generate flashcards or exercises of varying difficulty. A hybrid routing mechanism selects the most appropriate response strategy based on user intent. Evaluations using both isolated prompts and multi-turn dialogues demonstrate that the hybrid system significantly outperforms standard LLM baselines in terms of accuracy, consistency, and pedagogical suitability. A classroom trial with 20 students confirmed the tool’s usability and effectiveness; students reported high satisfaction and meaningful engagement. This study demonstrates that, with careful content and architectural structuring, generative AI can enhance student learning while supporting differentiated instruction. Future directions include scaling the approach to other topics and incorporating multimodal capabilities.

[full article @ publisher’s homepage]
[draft @ ResearchGate]

Reference: Mallweger, M., Brünner, B., Ebner, M. (2026). Generative AI Chatbots in Secondary Mathematics Education: Development and Implementation of a Dynamic Large Language Model-Based Learning Assistant for Quadrilaterals. In: Auer, M.E., Nikou, S.A. (eds) GenAI in Novel Educational Applications. Studies in Computational Intelligence, vol 1260. Springer, Cham. https://doi.org/10.1007/978-3-032-16153-6_7

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education.

Veröffentlicht am

[presentation] Guiding Innovation with Rapid EdTech User Experience Research Nodes #edmedia #SIG

We also did, as usual, the SIG (Special Interest Group) for Emerging Technologies at the EDMedia Conference. This year the session was titled „Guiding Innovation with Rapid EdTech User Experience Research Nodes„

This presentation is from the Special Interest Group Emerging Technologies for Learning and Teaching from EdMedia 2026 conference workshop on Guiding Innovation with Rapid EdTech User Experience Research Nodes (RETURN). It includes supporting resources for the RETURN Manifesto, selected EdTech case examples, and documentation related to rapid user experience research in educational technology contexts.

[Link to the slides]

This is an impactful contributions, methodological rigor, and exceptional novelty in the research field of AI in education.

Veröffentlicht am

[presentation] Code Meets Career: Employer Interpretations of Coding Bootcamp Graduates in Austria and Germany #research

Another talk we did at this year’s EDMEDIA conference is about the research of Daniela, titled „Code Meets Career: Employer Interpretations of Coding Bootcamp Graduates in Austria and Germany„

Coding bootcamps have expanded rapidly in response to persistent skill shortages in the IT sector and as alternative pathways into the field, particularly for groups underrepresented in technology, such as refugees and women. However, little is known about how these pathways are perceived and valued within organizations, especially in Austria and Germany.
This study therefore examines how companies in Austria and Germany perceive, evaluate, and integrate coding bootcamp graduates. Drawing on a qualitative content analysis of five semi-structured interviews with decision-makers in software development, IT consulting, and human resources, the study focuses on socially situated employer perspectives on skills, potential, and legitimacy, rather than measuring effectiveness in terms of employment outcomes.
The findings reveal an ambivalent picture: while graduates are valued for their motivation, adaptability, teamwork, and practical orientation, concerns persist regarding their theoretical depth and level of project experience. In the case of refugee participants, language proficiency is additionally identified as a key challenge. Overall, the study provides exploratory insights into how coding bootcamp qualifications are interpreted and evaluated by employers, rather than aiming to produce generalizable conclusions.

[Link to the slides]

Veröffentlicht am

[presentation] The OER Paradox in Ukraine #edmedia #research

Another presentation at this year’s EDMedia Conférence is about „The OER Paradox in Ukraine„

This study analyses the impact of the new Law of Ukraine „On Copyright and Related Rights“ (2811-IX) on the use of educational materials in the context of digital transformation and military crisis. Using the benchmarking methodology „15 cases in 15 countries“ and qualitative interviews with teachers, the work compares Ukrainian norms with the practice of EU countries. The results show that broad educational exceptions (in particular, Articles 22 and 24) create a situation of „legal comfort“ for the academic community, allowing the legal use of protected content in closed digital environments. However, this gives rise to the „OER paradox“: the absence of legal barriers to the use of proprietary resources reduces the motivation to create full-fledged open educational resources under free licenses. The paper highlights the need for institutional incentives to overcome dependence on closed content and integrate Ukraine into the global open education movement.

[Link to the slides]

Veröffentlicht am

[publication] Developing and Testing a Peer-Review Process for Content Quality Assurance in MOOCs: A Case Study on an E-Assessment Course #eassessment #tugraz

Our publication about „Developing and Testing a Peer-Review Process for Content Quality Assurance in MOOCs: A Case Study on an E-Assessment Course“ got published now.

Abstract:
This contribution presents the development and testing of a peer-review process for content quality assurance in MOOCs, implemented in the course “E-Assessment – auf Kurs gebracht”. The process was evaluated regarding complexity, duration, collaboration with external reviewers, and learners’ perception. Results show that the procedure can be smoothly integrated into MOOC development. Reviewers contributed beyond expectations by providing materials, didactic advice, and legal-ethical reflections. Learners rated the videos (very) positively (92.7% positive ratings, 100 participants, n = 812 answers), especially for structure and coherence. Slightly lower ratings for ‘visual appearance’ and ‘use of supportive linguistic elements’ can be explained by the course’s retro video design and the viewers’ understanding of how linguistic devices can be effectively used in educational videos. The study confirms peer review as a feasible and effective quality assurance approach that supports both collaboration and content improvement.

[article @ publisher’s homepage]
[draft @ researchgate]

Reference: Loitzenbauer, J., Ebner, M., Schön, S., Brünner, B. (2026). Developing and Testing a Peer-Review Process for Content Quality Assurance in MOOCs: A Case Study on an E-Assessment Course. In: Auer, M.E., Toth, P. (eds) Innovation via Collaborative Learning in Engineering Education. ICL 2025. Lecture Notes in Networks and Systems, vol 1847. Springer, Cham. https://doi.org/10.1007/978-3-032-18885-4_26

Veröffentlicht am

[publiation] AI-Powered Chatbots for Education Using RAGs #tugraz

Our publication about „AI-Powered Chatbots for Education Using RAGs“ got published right now.

Abstract:
This study examines the use of Retrieval-Augmented Generation (RAG) in AI-powered educational chatbots, focusing on embedding efficiency, large language model (LLM) performance, and context integrity. Implemented within the MOOC Informatik-Fit at TU Graz, the system supports scalable, curriculum-aligned self-paced learning. Three embedding models were evaluated, with text-embedding-ada-002 offering the best balance between semantic quality and cost-efficiency. Subsequently, three LLMs—GPT-3.5 Turbo, GPT-4o, and GPT-4o mini—were compared, revealing GPT-4o mini as the most cost-effective option while maintaining high accuracy and contextual coherence. Ethical robustness was assessed using 30 adversarial prompts, demonstrating strong resistance to jailbreaking in both GPT-4o and GPT-4o mini, supporting their suitability for secure and pedagogically reliable MOOC applications.
The paper also presents a replicable framework for the implementation of RAG-based systems, with the objective of promoting personalized, ethical, and accessible digital education on a large scale.

[article @ publisher’s homepage]
[draft @ ResearchGate]

Reference: Brünner, B., Deutschmann, F., Etzelstorfer, S., Lechner, A., Schön, S. & Ebner, M. (2029) “AI-Powered Chatbots for Education using RAGs: A Study on Embedding Efficiency, LLM Performance, and Context Integrity”. In: Transforming Education with Singularity Technologies: Lifelong Learning from Childhood to Adulthood (1st ed.). Uğur, S. (Ed.) Chapman and Hall/CRC. Chapter 9. 21 pages https://doi.org/10.1201/9781003584339