Reinforcement Learning

Hi everyone,

We have published the results and grades of the final exam, you find them on your Personal Status page. 

The exam inspection will take place on Friday, February 16, from 9:00 to 11:00. We will inform about the exact room of the inspection during the next week. 

The re-exam will take place on Monday, March 25th, from 10:00 to 12:00.

Best wishes, 
The Reinforcement Learning Team

Hi everyone,

the following contains information regarding the final exam next Monday. Please read it carefully and ask questions in the forum or by mail in advance.

The exam will start on Monday, February 5, at 14:15 and will take place in building E1.3, Lecture Halls 002 and 003. It will last 90 minutes.

You are allowed to bring one DIN A4 page with handwritten notes on both sides, no further auxiliary aids (in particular no calculator) are allowed.

Seating will begin at 14:00. We will put up seating plans next to the lecture hall entrances. You can look up your personal seat as well as the lecture hall also already now on your Personal Status page.

When entering, please leave your jackets and bags on the sides, turn off all electronic devices (smartphones, laptops, smartwatches, ...) and leave them in your bag.

Take to your seat only

• your UdS card as well as personal identification,
• writing materials (pens, rulers, ...),
• your cheat sheet,
• food and drinks if necessary.

You are not allowed to bring/use your own paper. We will provide you with enough paper during the exam.

Please make sure to arrive at the lecture hall on time at 14:00.

Kind regards and much success!

The Reinforcement Learning Team

Hi everyone!

We just published the results of the last exercise sheet, they are now visible on your Personal Status page. There, you can also see whether you have collected the necessary number of points to be admitted to the exam. 

The exam will take place on February 5, 2024 from 14:00-16:00 in Building E 1.3, Lecture Halls 002 and 003. 

Very important reminder: Please make sure that you register for the exam until one week before (so until next Monday) in the HISPOS-LSF! At those of you whose study program does not use HISPOS-LSF for exam administration: please send an E-Mail to Felix Jahn that you want to attend the exam.  

For the exam preparation, we will offer additional office hours. In the next week, there will be office hours on

• Monday, January 29, 16:00-18:00 in E 1.3, Lecture Hall 002 (so directly after the lecture in the same lecture hall)
• Thursday, February 1, 10:00-16:00 in E 1.3, Seminar Room 014 (so the usual Office Hour on Thursday)
• Friday, February 2, 13:00-15:00 in E 1.3, Seminar Room 328 (this is on the third floor)

We are happy to see many of you there as well as in tomorrow’s last tutorial. 

And a last announcement: Also the re-exam is now scheduled and will be on March 25, 10:00-12:00.

Best wishes,
Your RL-Lecture Team

Dear Students,

Unfortunately, Timo Gros, who was scheduled to give a practical introduction to Deep Q-learning, is currently ill and unable to present tomorrow. We wish Timo a speedy recovery and look forward to his presentation, which has been rescheduled for the 29th. Timo has prepared extensive material and demos that promise to be highly informative, so we are eager to have him with us on the new date.

In lieu of tomorrow's lecture, we will instead hold a short Q&A session. This will be an excellent opportunity for you to ask any questions and clarify doubts regarding the material we have covered so far. I would especially encourage you to bring questions related to the contents of our last video on policy gradient, ensuring that everyone is on the same page.

I apologize for any inconvenience this change may cause and appreciate your understanding and flexibility. The Q&A session will be held at the usual time and place (14:15 in HS002).

Best regards,
Prof. Verena Wolf.

Hi everyone!

The video of yesterdays online lecture is now accessible in the Materials section under "Lecture Recordings". It covers the remaining content about policy gradient methods and a short recap/overview of what we have seen so far in the course. On January 22 and January 29, we will have the two final lectures as usual in-person.

Also, the final Exercise Sheet E is now uploaded. As the Sheet was published a day later as usual, we extend the deadline for the exercises E.1 and E.2 to Tuesday, January 23, 14:00. The deadline for the exercises E.3 and E.4 remains on Monday, January 22, 12:00.

Best wishes,
Felix

Dear Students,

I am writing to inform you that I have tested positive for COVID-19 this morning. Hence, I will not give our scheduled lecture today but will prepare a video lecture covering today's material. This will be uploaded in the next few days for you to view at your convenience. We will have a dedicated Q&A session on the 22nd to address any questions regarding the lecture content. Please feel free to also use our forum if you have any questions.

Best regards,

Verena Wolf.

Hi everyone! 

With a solid delay of 24 hours, we have now published Exercise Sheet D and the corresponding materials. As usual, you can find them in the Materials section. As announced, the sheet contains a larger programming exercise. The deadline of this exercise sheet is due on Monday, January 8, 12:00.
For any questions and issues with the exercises, we will offer two Office Hours on Thursday, December 21 and Thursday, January 4, each from 10:00 to 16:00. 

Furthermore, also the lecture video about eligibility traces is now listed in the Materials section. 

Best wishes, 
Your RL-Lecture-Team

Hi everyone!

As discussed already in the forum, we made a very unfortunate mistake when creating the submission for the current exercise sheet. The deadline of the submission was mistakenly set to Monday, December 18, deviating from the usual "1-week-rhythm" and the deadline stated on the sheet.

To dissolve the resulting confusion: The deadline for the Exercise Sheet C is as usual on Monday, December 11, 12:00. As a courtesy, we extend the deadline for the programming exercise (Exercise C4) to Tuesday, December 12, 16:00. We hope that this helps you a little bit despite the spontaneity.

We really apologize for the confusion and the now very close deadline!

Have a nice Sunday evening! 

Hi everyone,

We have published the results and feedback to Exercise Sheet B. The sheet will be discussed in tomorrows tutorial, so it's the perfect place to ask any questions regarding the exercises or the grading. 

As announced already at the beginning of last week's tutorials, the tutorials at 10am and 2pm will be merged for the rest of the semester such that all tutorials will take place from now on in room E1.3, SR014. 

Have a nice evening and see you tomorrow!

Hi everyone!

We have published the results of the first assignment sheet. If you have any questions about the feedback or difficulties with certain topics covered on the sheet, please attend tomorrow's tutorials, come to office hours next week or ask in the forum.
Speaking of office hours, we have to announce a change of rooms. From now on, office hours will take place every second Thursday in E13, SR014. Further details can be found on the Timetable. 

Best wishes and see you tomorrow!

Hi everyone, 

We just uploaded the first exercise sheet and the corresponding notebook, you can find both files in the Materials section. Your solutions must be uploaded via your Personal Status page to the mCMS, recall that the sheet is due next Monday, 12:00.

We would also like to remind you of the Office Hour XXL in E1.3, SR 107 on Thursday from 10-16, where you can get help with questions and problems concerning the exercise sheet. 

Have a nice week! 

Hi everyone,

As some of you have already noticed, we have set up a Discourse forum for discussions about all topics surrounding the lecture and reinforcement learning. It is reachable via the navigation bar at the top of the cms-page.
In particular, there is a thread that can be used to find a team for the exercise sheets. We allow teams of up to 3 students, whereby it is not required to be in the same tutorial or tutorial slot.
On your "Personal Status"-page, you find the functionalities to create or join a team.

Have a nice weekend!

Hello everyone! 

We have just published the first training sheet that covers important basics of probability theory and statistics. You can find it under Information --> Materials. We will discuss the sheet and the content in the tutorials on this Thursday, November 2nd. Although the training sheets are completely optional, we recommend you to make sure you understand the concepts as they will be important as the lecture progresses. 

Also, we would like to remind you again that you can submit your tutorial preferences until 2pm on Wednesday. The tutorial assignments will then be published on Wednesday afternoon. 

Have a nice evening!