News

Grades Write-up, Review & Project

Written on 27.10.21 (last change on 27.10.21) by Timo Philipp Gros

Dear students, 

from now on, the grade of your write-up, review, and project as well as your final grade can be found on your Personal Status page. If you want feedback considering your grade, please contact your advisor. 

 

Best,

The MoSi-DRL Team

 

 

Hand-in Write-up

Written on 14.10.21 by Timo Philipp Gros

Dear students, 

from now on, you can hand in the final version of your write-up for. As already announced, the submission is open until Sunday, 17.10.21.

Best,

The MoSi-DRL Team

Reviews

Written on 08.10.21 by Timo Philipp Gros

Dear students, 

you should have received your review by mail by now. Otherwise, please contact us immediately. 

 

Best,

The MoSi-DRL Team

Maintenance Work

Written on 29.09.21 by Timo Philipp Gros

Dear students, 

due to important maintenance work, all servers of the computer science department will shut down from Friday until Sunday, and even possibly until Monday. 

During this time, neither our GitLab nor the Forum will be available. The latter includes the leaderboard and the… Read more

Dear students, 

due to important maintenance work, all servers of the computer science department will shut down from Friday until Sunday, and even possibly until Monday. 

During this time, neither our GitLab nor the Forum will be available. The latter includes the leaderboard and the evaluation. Also, we won't be reachable by mail. 

We are sorry for the inconvenience, but this is out of our hands. 

 

Best,

The MoSi-DRL Team

Reviews

Written on 28.09.21 by Timo Philipp Gros

Dear students, 

by now, you should have received an email with the write-ups you are about to review. 

Under Materials, you can find a template for the reviews, which gives you an idea of how your review could look like. From now on, the submission for the reviews is available on your Personal… Read more

Dear students, 

by now, you should have received an email with the write-ups you are about to review. 

Under Materials, you can find a template for the reviews, which gives you an idea of how your review could look like. From now on, the submission for the reviews is available on your Personal Status page. Please upload the two reviews separately and independently from your group members. The submission is open until Tuesday, the 5th of October. 

In general, a review without criticism is of no value, just as a review without positive feedback is. Please be critical but constructive. 
While there is no minimal or maximal length for your review, these reviews, in general, are between 1 and 2 pages long. Write down everything you find important, independent of the length of your review. 

If you have any questions, do not hesitate to ask by using the Forum

 

Best,

The MoSi-DRL Team

Write-up

Written on 23.09.21 by Timo Philipp Gros

PS: The non-final version of your write-up can be uploaded on your Personal Status page. Please upload one document for your entire group, containing all the individual parts and also the group part. 

Submission write-up, Deadline Extension Project, Evaluation

Written on 23.09.21 by Timo Philipp Gros

Dear students, 

from now on, you can hand in your non-final version of your write-up for the reviews. As we already announced, the submission is open until Sunday, 26.09.21.

Further, as some of you asked for additional time, we decided to shift the project's deadline. The final version of your… Read more

Dear students, 

from now on, you can hand in your non-final version of your write-up for the reviews. As we already announced, the submission is open until Sunday, 26.09.21.

Further, as some of you asked for additional time, we decided to shift the project's deadline. The final version of your project (which we will consider for grading) needs to be handed in together with the final version of your write-up (17.10.21). We hope that this additional amount of time will help you. 

Also, we will from now on evaluate your agents roughly every 6 hours to give you more feedback. 

Best,

The MoSi-DRL Team

Average Returns Szenarios S3 and S4

Written on 21.09.21 (last change on 21.09.21) by Timo Philipp Gros

Dear students, 

 

we have decided to decrease the average return needed to pass the scenarios S3 and S4. 

To pass, you will need an average return of:

  • S3: 70
  • S4: 55

As usual, we will test this average reward with the provided Hermes files. 

 

Best,

The MoSi-DRL… Read more

Dear students, 

 

we have decided to decrease the average return needed to pass the scenarios S3 and S4. 

To pass, you will need an average return of:

  • S3: 70
  • S4: 55

As usual, we will test this average reward with the provided Hermes files. 

 

Best,

The MoSi-DRL Team

 

 

Project - Evaluation of submitted agents

Written on 23.08.21 by Joschka Groß

Dear students,

as announced in the project presentation, even though you have access to everything you need to carry this out on your own, we still want to provide you with a service that automatically evaluates your submitted agents and reports the results back to you. This service is available… Read more

Dear students,

as announced in the project presentation, even though you have access to everything you need to carry this out on your own, we still want to provide you with a service that automatically evaluates your submitted agents and reports the results back to you. This service is available starting today.

Note that the fixed random seeds used by our evaluation runs and the exact evaluation parameters are also those used for grading your agents.

Details on how the evaluation service works can be found in our forum, so make sure to register if you have not already done so.

Best,

The MoSi-DRL Team

Slides Talks

Written on 17.08.21 by Timo Philipp Gros

Dear students, 

you can find the slides of your fellow students under Materials.

 

Best,

The MoSi-DRL Team

Result Talks, Slides Project Presentation

Written on 16.08.21 by Timo Philipp Gros

Dear students, 

 

from now on, the grade of your talk can be found on your Personal Status page. If you want feedback considering your grade, please contact your advisor. 

Further, you can find the slides from the project presentation under Materials.

 

 

Best,

The MoSi-DRL… Read more

Dear students, 

 

from now on, the grade of your talk can be found on your Personal Status page. If you want feedback considering your grade, please contact your advisor. 

Further, you can find the slides from the project presentation under Materials.

 

 

Best,

The MoSi-DRL Team

Link for tomorrow

Written on 11.08.21 by Timo Philipp Gros

Dear students, 

 

the meetings tomorrow and Friday will be in the same zoom room than the former meeting.

Please make sure to be punctually (08.30 am)! 

 

Best,

The MoSi-DRL Team

Project: mGit

Written on 09.08.21 (last change on 09.08.21) by Timo Philipp Gros

Dear students, 

we will use our own Gitlab instance to host the project. Therefore, you will need to register in our GitLab. Please do so before the first talks on Thursday and enter your user name on your Personal Status page.

 

Best, 

The MoSi-DRL Team

Deadline Talks

Written on 04.08.21 by Joschka Groß

Dear students,

This is a short reminder about tomorrows deadline regarding your talks. Until August 5th 23.59 CEST, you are required to send the following to your supervisor via email:

  • A preliminary version of your slides. For now, this can either be one PDF document, or 3 separate documents… Read more

Dear students,

This is a short reminder about tomorrows deadline regarding your talks. Until August 5th 23.59 CEST, you are required to send the following to your supervisor via email:

  • A preliminary version of your slides. For now, this can either be one PDF document, or 3 separate documents (one for each of your sub topics).
  • A category assignment regarding which group member is going to present which subtopic/category (a,b, or c).
  • Four multiple-choice questions (including solutions) which should serve the purpose of testing whether your audience has understood the content of your talks. These can be appended to your slides within the same document, or you can submit them as a separate PDF document.

Note that this submission is necessary for passing the seminar.

 

Best,

The MoSi-DRL Team

 

 

Schedule Talks

Written on 30.07.21 by Timo Philipp Gros

Dear students, 

this is the schedule for the talks:

August 12:
08.30 Value-based Methods
~ 09.00 Policy-gradient Methods
Coffee Break
10.30 DRL for Continuous Action Spaces
~ 11.45 End

August 13:
08.30 Improving Exploration
~ 09.45 Special Topics
Coffee Break
11.30 Project… Read more

Dear students, 

this is the schedule for the talks:

August 12:
08.30 Value-based Methods
~ 09.00 Policy-gradient Methods
Coffee Break
10.30 DRL for Continuous Action Spaces
~ 11.45 End

August 13:
08.30 Improving Exploration
~ 09.45 Special Topics
Coffee Break
11.30 Project Presentation
~12.30 End

 

Best, 

The MoSi-DRL Team

LSF Registration

Written on 24.07.21 by Timo Philipp Gros

Dear students, 

This is just a short reminder for you to register in the LSF. You can do that until July 26. Please don't forget to do that, as we have no options of letting you pass the seminar without an LSF registration. 

 

Best, 

The MoSi-DRL Team

Further Information Talks

Written on 20.07.21 by Timo Philipp Gros

Dear students, 

 

we have more information to share with you:

1. The talk of your group should last for one hour. Thus, the talk of each of your members should last for 20 minutes. You will need to adhere to the given time +- 5 %.

2. As 6 hours of talks are too long for you to stay focused… Read more

Dear students, 

 

we have more information to share with you:

1. The talk of your group should last for one hour. Thus, the talk of each of your members should last for 20 minutes. You will need to adhere to the given time +- 5 %.

2. As 6 hours of talks are too long for you to stay focused and all of you said to also be available on August 13, we would like to have the talks on August 12 and August 13 in the morning on both days. If you have any conflicts, please contact us. 

 

Further, your advisor will stretch out to make an appointment with you to discuss your progress in understanding the papers. 

Best, 

 

 

Topic Assignment

Written on 12.07.21 by Timo Philipp Gros

Dear students, 

 

you can now find your topic, your advisor, and your group mates on your Personal Status page.

We will send you and your group mates an email soon, such that you have the other's mail addresses and can work together. 

 

Best, 

The MoSi-DRL Team

Topic Preferences, LSF Registration

Written on 09.07.21 by Timo Philipp Gros

Dear Students, 

this is just a short reminder that you have to send your topic preferences by mail until Sunday at the latest. In case you haven't done so already, please use the following scheme:

Favour: 1,4 
Block: 3

(and please keep in mind that: 1 = Value-based Methods, 2… Read more

Dear Students, 

this is just a short reminder that you have to send your topic preferences by mail until Sunday at the latest. In case you haven't done so already, please use the following scheme:

Favour: 1,4 
Block: 3

(and please keep in mind that: 1 = Value-based Methods, 2 = Policy-gradient Methods, 3 =  DRL for Continuous Action Spaces, 4 = Improving Exploration, 5 = Special Topics / Model-Based DRL) 

Further, keep in mind that you have to register in the LSF. You can do that until July 26. Please don't forget to do that, as we have no options of letting you pass the seminar without an LSF registration. 

 

Best, 

The MoSi-DRL Team

Organization Slides

Written on 05.07.21 by Timo Philipp Gros

Dear students, 

we just uploaded the organization slides from todays kick-off meeting under Materials

There are a few changes to the version you saw this morning, all as discussed:

- we added information about the multiple choice questions you have to provide about your talk.
- we changed… Read more

Dear students, 

we just uploaded the organization slides from todays kick-off meeting under Materials

There are a few changes to the version you saw this morning, all as discussed:

- we added information about the multiple choice questions you have to provide about your talk.
- we changed the information about the topic selection (such that now everyone has to write an e-mail). 
- the typo with the topic selection deadline was fixed (it is July 11). 

We will publish the group assignment and the associated advisors next Monday (July 12). 

All appointments can now also one found under Timetable.

If you have questions, don't hesitate to contact us. 

 

Best, 

The MoSi-DRL Team

Kick-off

Written on 05.07.21 by Timo Philipp Gros

Dear students, 

please don't forget about todays Kick-off meeting at 10.00 am via zoom

 

Best, 

The MoSi-DRL Team

Talks

Written on 29.06.21 by Timo Philipp Gros

Dear students, 

we plan to have all talks on Thursday, August 12, as all of you answered to be available that day. 

If you have unforeseen conflicts with that appointment, please contact us immediately. 

 

Best, 

The MoSi-DRL Team

Talks Registration

Written on 24.06.21 by Timo Philipp Gros

Dear students, 

 

there was a problem with the registration when selecting several options. This problem is now fixed. Sorry for the inconvenience. You can now register for multiple days. 

 

Best, 

The MoSi-DRL Team

Talks

Written on 23.06.21 by Timo Philipp Gros

Dear students, 

we plan to have all talks as a (digital) block on a single day. 

To check your availability, you can now find four registrations (August 5,6, 12, and 13) on your Personal Status page. Please make use of that function in the following procedure:

- If you are fully available on… Read more

Dear students, 

we plan to have all talks as a (digital) block on a single day. 

To check your availability, you can now find four registrations (August 5,6, 12, and 13) on your Personal Status page. Please make use of that function in the following procedure:

- If you are fully available on that day, register for it. 
- If you are unavailable on that day due to an exam, do not register for it. 
- If you are available in principle but have a conflicting appointment, register for that day and write an email to Timo containing the information when you are unavailable. 

Please register for all dates that you are available on, not just the ones you like. If you don't take part (i.e., don't register for any day) we assume that you are always available. If you really can't attend any of these days, please also contact Timo

Please do so until Friday (June 25)!

 

Best, 

The MoSi-DRL Team

Welcome!

Written on 11.05.21 by Timo Philipp Gros

Welcome to the Deep Reinforcement Learning Seminar 2021.

Show all

Deep Reinforcement Learning

Reinforcement Learning (RL) is a popular subdiscipline of Machine Learning for problems that require strategies to solve complex tasks such as board games, scheduling problems or other discrete optimization problems. This seminar will discuss the theoretical basis of RL as well as popular RL-algorithms such as Deep Q-Learning. In the final phase of the seminar, the participants will apply these algorithms to the Racetrack benchmark. 

The seminar will include short presentations by the participants, a programming project that will be solved in small groups as well as a write-up.

The Kick-off will take place on Monday, July 5 at 10.00 am (sharp) via zoom. Participation is absolutely mandatory if you want to attend the seminar. If you have a colliding lecture please contact us immediately. The talks will be held on block mid-August, and the project will be placed after the talks.

 

 

Sources:
[1] Richard S. Sutton and Andrew G. Barto: Reinforcement Learning -  An Introduction (Second Edition)
[2] David Silver, Julian Schrittwieser, Karen Simonyan et al. : Mastering the game of Go without human knowledge
[3] Ahmad Hammoudeh : A Concise Introduction to Reinforcement Learning

Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators.