Legal aspects of generative artificial intelligence and large language models in examinations and theses.

Journal: GMS journal for medical education
PMID:

Abstract

The high performance of generative artificial intelligence (AI) and large language models (LLM) in examination contexts has triggered an intense debate about their applications, effects and risks. What legal aspects need to be considered when using LLM in teaching and assessment? What possibilities do language models offer? Statutes and laws are used to assess the use of LLM: - University statutes, state higher education laws, licensing regulations for doctors - Copyright Act (UrhG) - General Data Protection Regulation (DGPR) - AI Regulation (EU AI Act) LLM and AI offer opportunities but require clear university frameworks. These should define legitimate uses and areas where use is prohibited. Cheating and plagiarism violate good scientific practice and copyright laws. Cheating is difficult to detect. Plagiarism by AI is possible. Users of the products are responsible. LLM are effective tools for generating exam questions. Nevertheless, careful review is necessary as even apparently high-quality products may contain errors. However, the risk of copyright infringement with AI-generated exam questions is low, as copyright law allows up to 15% of protected works to be used for teaching and exams. The grading of exam content is subject to higher education laws and regulations and the GDPR. Exclusively computer-based assessment without human review is not permitted. For high-risk applications in education, the EU's AI Regulation will apply in the future. When dealing with LLM in assessments, evaluation criteria for existing assessments can be adapted, as can assessment programmes, e.g. to reduce the motivation to cheat. LLM can also become the subject of the examination themselves. Teachers should undergo further training in AI and consider LLM as an addition.

Authors

  • Maren März
    Charité- Universitätsmedizin Berlin, Kooperationspartner der Freien Universität Berlin, Humboldt-Universität Zu Berlin, Progress Test Medizin, Charitéplatz 1, Berlin, Germany.
  • Monika Himmelbauer
    Medical University of Vienna, Teaching Centre, Vienna, Austria.
  • Kevin Boldt
    The State Commissioner for Data Protection and Freedom of Information Rhineland-Palatinate, Mainz, Germany.
  • Alexander Oksche
    Institut für medizinische und pharmazeutische Prüfungsfragen (IMPP), Mainz, Germany.