Students use language models primarily for programming

A broad survey of students at ETH Zurich shows: Language models are still rarely used in the classroom, but they are used frequently and creatively as learning aids.

Students studying in the main building of ETH Zurich
Students studying in the main building. (Photograph: ETH Zurich / Alessandro Della Bella)

New AI tools, in particular language models such as ChatGPT, are actively used by ETH students. Preferably as support for programming tasks. This is shown by a survey conducted by the Teaching Development and Technology department (LET) together with the Department of Mathematics' Seminar for Statistics. Around 4800 or around a third of all students responded to the questions they were asked in September 2023.

Rarely used in courses, but often for learning

Students rarely encountered the new language models in courses. Only 17 per cent stated that they had already come into contact with a tool such as ChatGPT in a course.

In contrast, the tools are used extensively for independent learning. Most students stated that they use language models when programming, for example to write or explain programmes in the Python and R languages. Many also use the tools to help with text formatting in the word processing programme LaTeX. The second most frequently mentioned use of language models by students was to enhance, translate, or correct texts.

Bad at maths

Many students also use language models to prepare for exams, although they are well aware of the limitations of the systems. Particularly in mathematics, but also in specialised technical and scientific subjects, the systems often tend to hallucinate, i.e. they invent certain things.

Students report that they are often in dialogue with the language models in order to find entrances to topics or to be challenged, for example by looking for the errors in convincing-sounding answers. Some students also stated that they use ChatGPT to create exercises or flashcards based on lecture scripts.

Desire for custom language model

In the many free text responses, there was also a call for ETH to provide its students with a more reliable tool based on ETH materials and learning content. The Rectorate and the AI Centre are currently examining whether and how a user-defined language model could be trained with teaching materials.

In addition, a survey is currently being conducted among lecturers on how they use and benefit from AI tools in teaching.

Note on the translation

This text has been translated for your convenience using a machine translation tool. Although reasonable efforts have been made to provide an accurate translation, it may not be perfect. If in doubt, please refer to the German version.

Should you come upon significant translation mistakes, please send a short message to so that we can correct them. Thank you very much.

Always up to date

Would you like to always receive the most important internal information and news from ETH Zurich? Then subscribe to the "internal news" newsletter and visit Staffnet, the information portal for ETH employees.

JavaScript has been disabled in your browser