FAQs for students about course evaluation at Goethe University

Studierende5_100_150

Course evaluation (LVE, Lehrveranstaltungsevaluation) is a central tool for quality assurance in teaching at Goethe University and is conducted every three semesters. In the meantime, departments can conduct voluntary evaluations or focus on specific aspects of evaluation. The survey is conducted "online in person," meaning that students complete the questionnaires using their own mobile devices (smartphones, tablets, laptops) during the course being evaluated. Participants in these anonymous surveys are not identifiable, and the process has been coordinated with Goethe University's data protection officer.

Your participation in these surveys is very important to us. Only when you provide your feedback about the course can your instructors engage in a dialog with you about potential improvements. On this website, we answer frequently asked questions from students about course evaluation. If you have any further questions, please do not hesitate to contact us.


Goals

The goal of course evaluation is the continuous improvement of teaching at Goethe University. Course evaluations are intended to stimulate dialog between faculty and students in order to identify areas for improvement. The results are usually presented by the instructor at the post-evaluation meeting or at the end of the semester. They then have the opportunity to discuss individual aspects or the quality of the course as a whole. The evaluation process thus contributes to the continuous development and improvement of the academic experience.

In addition, LVE fulfills Goethe University's obligation to regularly evaluate its tasks in accordance with § 12 (1) of the Hessian Higher Education Act.

Participating in course evaluations is a great way to actively contribute to improving the quality of a course. You will not benefit directly from your own suggestions for improvement, as you will generally not be taking the same course again. However, you will be part of the ongoing development of the course since you will profit from the evaluations of previous students and you will enable future generations to do the same. In addition, you will contribute to the overall development of teaching in your department, which will be beneficial to you when you take other courses in the future.

Some critics see LVE as an marketing instrument in higher education policy, of goal- and outcome-based management, and of a shift towards a greater "customer" focus. Some fear that this could restrict teaching freedom.

At Goethe University, LVE is not a central control instrument to monitor the achievement of a learning goal or the use of certain formats. Rather, it serves to initiate an exchange between students and faculty about good teaching, so that they can improve the course for all participants.
Individual results of course evaluations are not discussed at the university level, but in the study commissions of the individual faculties. In the case of any irregularities, the study commission may, for example, recommend that the lecturer attend appropriate courses in university teaching. Instructors are not threatened with any form of penalty or loss of salary.
There is only a merit pay for professors. The average score on items 1.1 to 1.7 of the Basic Questionnaire (see "Which questionnaires are used?") was previously one of several criteria used to determine an extra pay allowance as part of the W salary (W-Besoldung). In the future, however, other criteria that document the professor's commitment to teaching will be used for this purpose. A corresponding change is being worked on by the responsible Senate committee.

Both quantitative and qualitative course evaluations are empirically sound methods of evaluation, each with advantages and disadvantages. What both evaluation methods have in common is that they allow students to provide anonymous feedback on their course. The advantage of quantitative evaluation is that students can provide structured feedback on the course within a relatively short period of time. In addition, quantification allows results to be compared over time and between instructors. Qualitative methods, on the other hand, allow for more in-depth discussion of individual points.

At a large university such as Goethe University, it is not possible to implement a qualitative course evaluation procedure as a standard procedure. However, qualitative instruments are used in other areas of quality management, such as course evaluation.

A mixed methods approach was chosen for the course evaluation in order to take advantage of both quantitative and qualitative evaluation methods. In addition to a standardized questionnaire with closed-ended response options, two open-ended response sections provide information about the strengths and areas for improvement of the course. The open-ended responses provide instructors with valuable assessments of specific aspects of their courses and concrete suggestions for improvement. At the same time, the standardized information allows instructors to track their results over time and compare them to the results of other instructors in the faculty.

Instructors also have the option of using other qualitative tools to evaluate the course. They also receive information about this in specific training courses offered by Interdisziplinäre Kolleg Hochschuldidaktik (IHK).

Content

The evaluation questionnaires at Goethe University are modular. There is a basic questionnaire that assesses basic aspects of teaching quality. In addition, information about the evaluator is collected, such as the semester of study. In addition, instructors can select a maximum of three of 16 supplementary questionnaires per survey to evaluate additional aspects of the course.

The modular principle offers an ideal balance between the use of comparable and standardized questionnaires and the individual design of the questionnaires according to the lecturers' main areas of interest.

Some faculties use their own questionnaires. Even in these cases, however, the central basic questionnaire is always used, which is then extended by subject-specific supplements. If a faculty uses subject-specific supplementary questionnaires, none of the above-mentioned supplementary questionnaires may be added.
The basic and supplemental questionnaires used  at Goethe University were developed by an interdepartmental working group under the supervision of the Department of Teaching and Quality Assurance (Lehre und Qualitätssicherung) in collaboration with studiumdigitale and approved by the Senate. Subject-specific supplements are developed by the Department of Teaching and Quality Assurance together with the individual faculties and studiumdigitale. The most recent research findings in the field of evaluation are always taken into account in the development and revision of the questionnaires.
The standardization of the questionnaires has the advantage that instructors can compare their results with the results of other faculty members in their department as well as with their own previous results. However, the modular approach ensures a certain degree of variation within the questionnaires (see "Which questionnaires are used?").

Procedure

When in the semester are courses evaluated?

Typically, the evaluation takes place about two-thirds of the way through the course. This is enough time for you to have formed an opinion about the course being evaluated. It also allows time for the instructor to discuss the results with you during the course and make any necessary improvements. This does not apply to block seminars and field trips, which are usually evaluated after the course has ended.

How often do course evaluations take place?

Since the summer semester of 2018, course evaluations have been conducted as a mandatory full survey every three semesters. In the two intermediate semesters, faculties are free to decide whether to make the evaluation voluntary, to set a mandatory minimum number of courses to be evaluated, or to set specific evaluation priorities (e.g. all "new" lecturers, all seminars, etc.). In addition, faculties may choose to conduct a full survey in the interim semesters. The decision for one of these options is usually made by the faculty council after consultation with the study commission.

The advantages of this procedure are that all courses in a faculty are regularly evaluated through the mandatory comprehensive survey. Moreover, by setting priorities, courses that have never or rarely been evaluated can be examined more closely. Finally, the voluntary nature of the process can help reduce evaluation fatigue among students and faculty.


When is a mandatory comprehensive survey (Vollerhebung) carried out in my faculty?

As of the summer semester 2018, the LVE is administered as a mandatory comprehensive survey every three semesters (see "How often do course evaluations take place?"). For organizational reasons, the full survey cycle will not begin at the same time in all faculties. Here is an overview of when the full survey is expected to take place in different faculties:

Winter semester 2020/21: Faculties 03, 08, 09, 15
Summer semester 2021: Faculties 02, 05, 10, 14
Winter semester 2021/22: Faculties 01, 04, 06, 07, 11, 12, 13, 16


In addition, regular full surveys are carried out in Faculties 02 and 16. The periodic schedule of the faculities is maintained in the following semesters hrt.

How are the interim semesters organized in my faculty?

The scheduling of interim semesters is decided by the faculty for each semester. The decision is usually made by the faculty council after consultation with the study commission. To find out the status for the current semester in your faculty, please contact the student representative or your faculty dean.


Can I register my instructor for course evaluation outside of the comprehensive surveys

Whether a course is evaluated outside of the mandatory comprehensive survey is up to the faculty or instructor, depending on the interim semester schedule (see "How often do course evaluations take place?"). Of course, you can also give verbal or written feedback on the quality of teaching at any time, even without a questionnaire.

Why does the evaluation take place "online in person"?

The evaluation takes place "online, in person," i.e. you complete the questionnaire in the course using your own Internet-enabled mobile device. This form of evaluation has several advantages.

Compared to a paper-based procedure, the online mode provides instructors with results within a few working days. This means that the feedback can usually be discussed within the same course, with the exception of block seminars, lecture series, and field trips. In addition, the information is now typewritten and therefore more anonymous and easier to read than the paper questionnaires. Finally, the process is more environmentally friendly because no paper is used.

The evaluation takes place "in person" because your feedback is central to the continuous development of teaching at Goethe University. The face-to-face evaluation explicitly gives you the time you need to complete the questionnaire conscientiously. This ensures a high response rate and meaningful results.


How can I participate in the survey?
To participate in the course evaluation, you will need to bring an Internet-enabled mobile device, such as a smartphone, tablet, or laptop, to the course you are evaluating on the day of the evaluation. After entering the link and/or QR code provided by the instructor, you will be able to start the survey.


What if I don't have an Internet-enabled mobile device?
If you do not have a suitable device, we ask you to borrow one from your classmates. Every piece of feedback counts in the development of the course, including yours!


Do I have to log in to the Goethe University WLAN network?

If you have sufficient network coverage, you can choose any available network. In addition, loading a survey uses very little data volume overall, so you can decide for yourself whether you want to log in to the Goethe University WLAN.


How long does the evaluation take?

The length of the questionnaires varies depending on the number of questionnaires selected. Instructors can select up to three supplemental questionnaires in addition to the basic questionnaire. Depending on whether and how many supplements are selected, the average time to complete a questionnaire is between 5 and 15 minutes. In recent years, the questionnaires have been streamlined so that a supplemental questionnaire typically contains fewer than 10 items (questions). This means that the value of the information for the teachers is now more in line with the time required.

All in all, including the introduction by the instructor, entering the link, etc., the evaluation takes between 10 and 20 minutes.


How can I participate if my Internet connection is slow or unavailable?

Evaluating online has many advantages (see "Why does the evaluation take place online, in person?"). However, the questionnaires may be slow to load and/or you may not be able to submit your results or receive confirmation immediately, especially if the network is busy due to a high volume of evaluations. In this case, your instructor will ask you to pause the survey and resume it later, possibly with a time delay within the group.

The only exception to online evaluation is the field trip. Since students often do not have access to the Internet (e.g., on field trips abroad), field trip instructors may request a paper-based evaluation in certain cases.


How long are the links active?

The links are time-controlled. The lecturer shows the PDF with the link/QR code to the students at any time during the course. At the end of the evaluation window, which covers the same period as the course, the link is deactivated.

What is the minimum number of participants for instructors to receive results?

Instructors see the evaluation results when at least four students have completed the form. This ensures the anonymity of the participants.


Do I have to participate?

Participation in course evaluations is voluntary. However, please note that your feedback is extremely valuable to the instructors and students who follow you. You will also benefit from the evaluations of previous students!

Why is my feedback so important?

Only the students attending a course can tell the instructor what was lacking or helpful in the course. Your participation can make a difference in the instructor's ability to improve the course in the future. Instructors also get valuable feedback when they try new teaching strategies. Take advantage of the opportunity to be heard!

How do I structure my feedback so that it helps improve instruction?

Always give feedback in the way you would like to receive it - that is, in a constructive and helpful manner. Remember that the goal is to improve the quality of teaching, not to criticize the instructor.

Following these guidelines will help the recipient of your feedback:

  • Avoid generic feedback ("always," "never"...). Instead, be specific about what aspect of the course you are criticizing.
  • Give reasons and examples for your opinion.
  • Provide specific suggestions for improvement.
  • Remain objective and avoid personal and disparaging feedback.
  • Use clear language, be logical, and be consistent.
  • Write in the "I" form. This makes it clear that your feedback is based on your personal view and does not apply to everyone.
  • Respect the instructor's teaching style and be realistic in your expectations.

When do the instructors obtain the results and which reports are sent to them?

Instructors typically receive a results report in PDF format within three business days of the survey. This report shows the mean scale scores, the percentage distribution of responses to each scale item, and the standard deviation of responses per scale in aggregated form.

In addition, at the end of the semester, instructors will receive a summary report that compares the mean scores on the basic questionnaire items to the scores of other instructors in the faculty and to the scores of other courses of the same type (e.g., tutorials) in the faculty. If at least five instructors in the faculty have selected the same supplemental questionnaire, these comparisons are also made for the items on the supplemental questionnaires.

In addition, instructors can request subgroup comparisons that break down the results by gender, semester, and intended degree. However, there must be at least four responses per subgroup in order to maintain the anonymity of the participants.


How can I obtain the results?

In general, you should receive the results when your instructor discusses them with you during the course. However, this is not always possible. For example, in block seminars or field trips, evaluations are given in the last class or at the end of the course, leaving no time for discussion.

There are different approaches to publishing the results, both between faculties and among instructors. While many instructors discuss the results in class, others do not report the results, even if they have time to do so in class. In some departments, the results are generally published, e.g. on the Internet or on a bulletin board.

While we encourage instructors to engage in dialog with students, this is the instructor's personal decision. If your instructor does not discuss the results with you, but you would like to, we encourage you to ask him or her to do so. Only by entering into a dialog can you reflect on the results together and clarify any questions. In case of doubt, you can contact faculty dean or student representative.


What will my instructor do with my feedback?

Students often express the concern that lecturers are not really interested in the results. However, the findings of two instructor surveys conducted by the evaluation team after the 2016-17 winter semester and the 2017 summer semester show that this is generally not the case. Only three percent of the instructors in the surveys indicated that they do not use the results in any way. In contrast, almost all instructors reported using the results as individual feedback (88%). About half said they would discuss the results with students (51%). Forty-three percent said they would discuss it with colleagues, and 13% said they would discuss it with senior staff. Approximately a quarter of respondents attended a university teaching course based on the results (24%). As you can see, even if your instructor does not or cannot discuss the results with you, your feedback matters!

Data privacy

In principle, anyone can view the results once the instructor has posted them. The results are usually made available to the concerned students by the instructor who discusses the results with them. In addition, the (academic) deans and study commissions in the faculties usually have access to the results so that they can discuss them for the purpose of quality assurance in teaching. Please note, however, that the study commissions do not meet in public and that the members of the commissions are obliged to maintain the confidentiality of the results.

The data can be viewed by the staff of the central teaching and quality assurance departments responsible for course evaluations and by the studiumdigitale office responsible for carrying out the evaluations. Those responsible for course evaluation in the deans' offices also have access to the data. They are trained to handle the data and are also obliged to maintain confidentiality.

In the basic questionnaire, you will be asked to provide your gender, your intended degree, and your semester of study. In addition, a supplementary questionnaire on student diversity can be used to obtain further socio-demographic information, such as the level of education of your parents.

Despite providing this information, you will not be identified at any time by the groups of people who have access to the results. Therefore, the data collected about you is not personal data within the meaning of Art. 4 GDPR. 

The results are only reported back to the instructors and deans' offices in aggregate form, and at least four students must have participated in the survey to provide feedback. The course evaluation staff members who have access to the raw data (see "Who can view the results?") do not at any time have the ability to link your course evaluation data with other internal university databases, such as matriculation or address data, in order to identify you. You cannot be identified by your IP address either, as we do not collect it. In addition, staff members are required to maintain the confidentiality of individual results.

Course evaluations serve the sole purpose of quality assurance at Goethe University. As part of quality management, the department of teaching and quality assurance (Abteilung Lehre und Qualitätssicherung) may also publish the results in aggregated form in appropriate internal university reports. However, the results of the courses must be available from at least five lecturers with at least four participants each.

Course evaluations are also subject to continuous quality control, for which the Department of Teaching and Quality Assurance can conduct analyses based on LVE data.

The course evaluation data will be stored on a secure server at studiumdigitale for 10 years. In paper form, the aggregated results are stored for three years (see §15 (10) of the evaluation statutes of Goethe University).

Since you cannot be identified by your data in the evaluation (see "Am I identifiable?"), it is not possible to delete your data according to Art. 17 EU GDPR or to object to the processing of your data pursuant to Art. 21 EU GDPR.

At no time will course evaluation (LVE) data records be shared with external parties.

The results reports can be used by instructors as they see fit. For example, they can publish them or use them for application procedures. In general, faculties can decide to publish the results after a decision by the faculty council. Nevertheless, the instructors must agree to the publication. In addition, aggregated evaluations of LVE can be used in the context of course development.

Course evaluation (LVE) regulations and procedures are currently being revised. As soon as they are published, you will find a link to these documents here.

Contact

Couldn't find an answer to your question?

If you have any questions, please contact Jana Niemeyer (SLI), e-mail: niemeyer@em.uni-frankfurt.de, tel. (069)798-12489

Status September 2022

Contact

Jana Niemeyer

Course evaluation

Theodor-W.-Adorno-Platz 1
PEG building, 1.G039


Phone: (069)798-12489
E-mail: niemeyer@em.uni-frankfurt.de