News
Grades Write-up, Review & ProjectWritten on 27.10.21 (last change on 27.10.21) by Timo Philipp Gros Dear students, from now on, the grade of your write-up, review, and project as well as your final grade can be found on your Personal Status page. If you want feedback considering your grade, please contact your advisor.
Best, The MoSi-DRL Team
|
Hand-in Write-upWritten on 14.10.21 by Timo Philipp Gros Dear students, from now on, you can hand in the final version of your write-up for. As already announced, the submission is open until Sunday, 17.10.21. Best, The MoSi-DRL Team |
ReviewsWritten on 08.10.21 by Timo Philipp Gros Dear students, you should have received your review by mail by now. Otherwise, please contact us immediately.
Best, The MoSi-DRL Team |
Maintenance WorkWritten on 29.09.21 by Timo Philipp Gros Dear students, due to important maintenance work, all servers of the computer science department will shut down from Friday until Sunday, and even possibly until Monday. During this time, neither our GitLab nor the Forum will be available. The latter includes the leaderboard and the… Read more Dear students, due to important maintenance work, all servers of the computer science department will shut down from Friday until Sunday, and even possibly until Monday. During this time, neither our GitLab nor the Forum will be available. The latter includes the leaderboard and the evaluation. Also, we won't be reachable by mail. We are sorry for the inconvenience, but this is out of our hands.
Best, The MoSi-DRL Team |
ReviewsWritten on 28.09.21 by Timo Philipp Gros Dear students, by now, you should have received an email with the write-ups you are about to review. Under Materials, you can find a template for the reviews, which gives you an idea of how your review could look like. From now on, the submission for the reviews is available on your Personal… Read more Dear students, by now, you should have received an email with the write-ups you are about to review. Under Materials, you can find a template for the reviews, which gives you an idea of how your review could look like. From now on, the submission for the reviews is available on your Personal Status page. Please upload the two reviews separately and independently from your group members. The submission is open until Tuesday, the 5th of October. In general, a review without criticism is of no value, just as a review without positive feedback is. Please be critical but constructive. If you have any questions, do not hesitate to ask by using the Forum.
Best, The MoSi-DRL Team |
Write-upWritten on 23.09.21 by Timo Philipp Gros PS: The non-final version of your write-up can be uploaded on your Personal Status page. Please upload one document for your entire group, containing all the individual parts and also the group part. |
Submission write-up, Deadline Extension Project, EvaluationWritten on 23.09.21 by Timo Philipp Gros Dear students, from now on, you can hand in your non-final version of your write-up for the reviews. As we already announced, the submission is open until Sunday, 26.09.21. Further, as some of you asked for additional time, we decided to shift the project's deadline. The final version of your… Read more Dear students, from now on, you can hand in your non-final version of your write-up for the reviews. As we already announced, the submission is open until Sunday, 26.09.21. Further, as some of you asked for additional time, we decided to shift the project's deadline. The final version of your project (which we will consider for grading) needs to be handed in together with the final version of your write-up (17.10.21). We hope that this additional amount of time will help you. Also, we will from now on evaluate your agents roughly every 6 hours to give you more feedback. Best, The MoSi-DRL Team |
Average Returns Szenarios S3 and S4Written on 21.09.21 (last change on 21.09.21) by Timo Philipp Gros Dear students,
we have decided to decrease the average return needed to pass the scenarios S3 and S4. To pass, you will need an average return of:
As usual, we will test this average reward with the provided Hermes files.
Best, The MoSi-DRL… Read more Dear students,
we have decided to decrease the average return needed to pass the scenarios S3 and S4. To pass, you will need an average return of:
As usual, we will test this average reward with the provided Hermes files.
Best, The MoSi-DRL Team
|
Project - Evaluation of submitted agentsWritten on 23.08.21 by Joschka Groß Dear students, as announced in the project presentation, even though you have access to everything you need to carry this out on your own, we still want to provide you with a service that automatically evaluates your submitted agents and reports the results back to you. This service is available… Read more Dear students, as announced in the project presentation, even though you have access to everything you need to carry this out on your own, we still want to provide you with a service that automatically evaluates your submitted agents and reports the results back to you. This service is available starting today. Note that the fixed random seeds used by our evaluation runs and the exact evaluation parameters are also those used for grading your agents. Details on how the evaluation service works can be found in our forum, so make sure to register if you have not already done so. Best, The MoSi-DRL Team |
Slides TalksWritten on 17.08.21 by Timo Philipp Gros Dear students, you can find the slides of your fellow students under Materials.
Best, The MoSi-DRL Team |
Result Talks, Slides Project PresentationWritten on 16.08.21 by Timo Philipp Gros Dear students,
from now on, the grade of your talk can be found on your Personal Status page. If you want feedback considering your grade, please contact your advisor. Further, you can find the slides from the project presentation under Materials.
Best, The MoSi-DRL… Read more Dear students,
from now on, the grade of your talk can be found on your Personal Status page. If you want feedback considering your grade, please contact your advisor. Further, you can find the slides from the project presentation under Materials.
Best, The MoSi-DRL Team |
Link for tomorrowWritten on 11.08.21 by Timo Philipp Gros Dear students,
the meetings tomorrow and Friday will be in the same zoom room than the former meeting. Please make sure to be punctually (08.30 am)!
Best, The MoSi-DRL Team |
Project: mGitWritten on 09.08.21 (last change on 09.08.21) by Timo Philipp Gros Dear students, we will use our own Gitlab instance to host the project. Therefore, you will need to register in our GitLab. Please do so before the first talks on Thursday and enter your user name on your Personal Status page.
Best, |
Deadline TalksWritten on 04.08.21 by Joschka Groß Dear students, This is a short reminder about tomorrows deadline regarding your talks. Until August 5th 23.59 CEST, you are required to send the following to your supervisor via email:
Dear students, This is a short reminder about tomorrows deadline regarding your talks. Until August 5th 23.59 CEST, you are required to send the following to your supervisor via email:
Note that this submission is necessary for passing the seminar.
Best, The MoSi-DRL Team
|
Schedule TalksWritten on 30.07.21 by Timo Philipp Gros Dear students, this is the schedule for the talks: August 12: August 13: Dear students, this is the schedule for the talks: August 12: August 13:
Best, |
LSF RegistrationWritten on 24.07.21 by Timo Philipp Gros Dear students, This is just a short reminder for you to register in the LSF. You can do that until July 26. Please don't forget to do that, as we have no options of letting you pass the seminar without an LSF registration.
Best, |
Further Information TalksWritten on 20.07.21 by Timo Philipp Gros Dear students,
we have more information to share with you: 1. The talk of your group should last for one hour. Thus, the talk of each of your members should last for 20 minutes. You will need to adhere to the given time +- 5 %. Dear students,
we have more information to share with you: 1. The talk of your group should last for one hour. Thus, the talk of each of your members should last for 20 minutes. You will need to adhere to the given time +- 5 %.
Further, your advisor will stretch out to make an appointment with you to discuss your progress in understanding the papers.
|
Topic AssignmentWritten on 12.07.21 by Timo Philipp Gros Dear students,
you can now find your topic, your advisor, and your group mates on your Personal Status page. We will send you and your group mates an email soon, such that you have the other's mail addresses and can work together.
Best, |
Topic Preferences, LSF RegistrationWritten on 09.07.21 by Timo Philipp Gros Dear Students, this is just a short reminder that you have to send your topic preferences by mail until Sunday at the latest. In case you haven't done so already, please use the following scheme:
(and please keep in mind that: 1 = Value-based Methods, 2… Read more Dear Students, this is just a short reminder that you have to send your topic preferences by mail until Sunday at the latest. In case you haven't done so already, please use the following scheme:
(and please keep in mind that: 1 = Value-based Methods, 2 = Policy-gradient Methods, 3 = DRL for Continuous Action Spaces, 4 = Improving Exploration, 5 = Special Topics / Model-Based DRL) Further, keep in mind that you have to register in the LSF. You can do that until July 26. Please don't forget to do that, as we have no options of letting you pass the seminar without an LSF registration.
Best, |
Organization SlidesWritten on 05.07.21 by Timo Philipp Gros Dear students, we just uploaded the organization slides from todays kick-off meeting under Materials. There are a few changes to the version you saw this morning, all as discussed: - we added information about the multiple choice questions you have to provide about your talk. Dear students, we just uploaded the organization slides from todays kick-off meeting under Materials. There are a few changes to the version you saw this morning, all as discussed: - we added information about the multiple choice questions you have to provide about your talk. We will publish the group assignment and the associated advisors next Monday (July 12). All appointments can now also one found under Timetable. If you have questions, don't hesitate to contact us.
Best, |
Kick-offWritten on 05.07.21 by Timo Philipp Gros Dear students, please don't forget about todays Kick-off meeting at 10.00 am via zoom.
Best, |
TalksWritten on 29.06.21 by Timo Philipp Gros Dear students, we plan to have all talks on Thursday, August 12, as all of you answered to be available that day. If you have unforeseen conflicts with that appointment, please contact us immediately.
Best, |
Talks RegistrationWritten on 24.06.21 by Timo Philipp Gros Dear students,
there was a problem with the registration when selecting several options. This problem is now fixed. Sorry for the inconvenience. You can now register for multiple days.
Best, |
TalksWritten on 23.06.21 by Timo Philipp Gros Dear students, we plan to have all talks as a (digital) block on a single day. To check your availability, you can now find four registrations (August 5,6, 12, and 13) on your Personal Status page. Please make use of that function in the following procedure: - If you are fully available on… Read more Dear students, we plan to have all talks as a (digital) block on a single day. To check your availability, you can now find four registrations (August 5,6, 12, and 13) on your Personal Status page. Please make use of that function in the following procedure: - If you are fully available on that day, register for it. Please register for all dates that you are available on, not just the ones you like. If you don't take part (i.e., don't register for any day) we assume that you are always available. If you really can't attend any of these days, please also contact Timo. Please do so until Friday (June 25)!
Best, |
Welcome!Written on 11.05.21 by Timo Philipp Gros Welcome to the Deep Reinforcement Learning Seminar 2021. |
Deep Reinforcement Learning
Reinforcement Learning (RL) is a popular subdiscipline of Machine Learning for problems that require strategies to solve complex tasks such as board games, scheduling problems or other discrete optimization problems. This seminar will discuss the theoretical basis of RL as well as popular RL-algorithms such as Deep Q-Learning. In the final phase of the seminar, the participants will apply these algorithms to the Racetrack benchmark.
The seminar will include short presentations by the participants, a programming project that will be solved in small groups as well as a write-up.
The Kick-off will take place on Monday, July 5 at 10.00 am (sharp) via zoom. Participation is absolutely mandatory if you want to attend the seminar. If you have a colliding lecture please contact us immediately. The talks will be held on block mid-August, and the project will be placed after the talks.
Sources:
[1] Richard S. Sutton and Andrew G. Barto: Reinforcement Learning - An Introduction (Second Edition)
[2] David Silver, Julian Schrittwieser, Karen Simonyan et al. : Mastering the game of Go without human knowledge
[3] Ahmad Hammoudeh : A Concise Introduction to Reinforcement Learning