Course Information

   Yun-Nung (Vivian) Chen
   Online on YouTube and COOL
   Thursday 09:10 - 12:10

Syllabus

Date Description Course Recordings Note
2022/09/08 Course Logistics
Introduction

0
1.1 1.2 1.3
 PyTorch
2022/09/15 Neural Network Basics
Backpropagation
2.1 2.2 2.3 2.4
2.5
2022/09/22 Word Representation
Recurrent Neural Network 		3.1
3.2 3.3 3.4
2022/09/29 Gating Mechanism
Word Embeddings
 4
5.1 5.2 5.3 5.4 5.5 5.6
2022/10/06 ELMo
Attention Mechanism
 6.1 6.2
7.1 7.2
2022/10/13 Transformer
Subword Tokenization
BERT 		8.1 8.2 8.3
9
10.1
2022/10/20 More BERT
 11.1 11.2 11.3 11.4
2022/10/27 Midterm Break
彈性補充 Reinforcement Learning
Value-Based RL
 11.1 11.2 11.3
11.4 11.5 11.6
彈性補充 Policy Gradient & Actor-Critic
11.7 11.8
2022/11/10 Natural Language Generation
 13.1 13.2 13.3 13.4
2022/11/17 Model Pre-Training 14.1 14.2 14.3 14.4 14.5 14.6
2022/11/24 Prompt-Based Learning 15.1 15.2 15.3 15.4 15.5
2022/12/01 Beyond Supervised Learning 16.1 16.2 16.3 16.4 16.5
2022/12/08 Issues in Pre-Trained Models 17.1 17.2 17.3 17.4
2022/12/15 Break
2022/12/22 Final Break
2022/12/29 Multimodality
Sharing 		18.1 18.2
Sharing

Homework

The assignments should be submitted via NTU COOL.
NO LATE SUBMISSION IS ALLOWED!

  • Please make sure that you have computing resources for training deep models.
  • Please make sure that your GitHub repo for homework is private.

Teaching Team

Please send your questions to adl-ta@csie.ntu.edu.tw.
Please make sure the title of your mail starts with [ADL2022].

Role Name Work Office Hour Location
TA 林彥廷 HW 1 TBA
TA HW 2 R524
TA HW 3 R524
TA Project R524