1 |
1/06 - 1/10 |
- Course introduction
- Text data preprocessing: Normalization, lemmatization, stemming, stop words removal…
- Text Representations:
- One hot encoding
- BoW (frequency counting)
- TF-IDF
|
|
Quiz 0 | Knowledge-based | out 1/06 - due 1/10 |
- Chapter 1 Introduction to Natural Language Processing by Jacob Eisenstein
- Chapter 2.1 Introduction to Natural Language Processing by Jacob Eisenstein
|
2 |
1/13 - 1/17 |
- Classification Introduction
- Naive Bayes
- Classification Model Evaluation: accuracy, precision, recall, confusion matrix
|
|
Quiz 1 | week 1| out 1/10 - due 1/17 |
- Chapter 2.2 Introduction to Natural Language Processing by Jacob Eisenstein
|
3 |
1/20 - 1/24 |
- MLK Official Institute Holiday
- Focus on HW1
|
|
|
|
4 |
1/27 - 1/31 |
- Logistic Regression
- SVM
- Perceptron
|
- HW1 due 1/31
- HW2 out 1/31
|
Quiz 2 | week 2| out 1/24 - due 1/31 |
- Chapters 2.3, 2.4, 2.5 Introduction to Natural Language Processing by Jacob Eisenstein.
|
5 |
2/03 - 2/07 |
- SVD (Dimensionality Reduction) + Co-occurrence embeddings
- Glove
|
|
Quiz 3 | week 4| out 1/31 - due 2/07 |
|
6 |
2/10 - 2/14 |
- Neural Network (fully connected)
- Word2vec: CBoW, Skip-Gram
|
|
Quiz 4 | week 5| out 2/07 - due 2/14 |
|
7 |
2/17 - 2/21 |
- Toolbox on Classification Algorithms
- Toolbox on Word2Vec
|
- HW2 due 2/21
- HW3 out 2/21
|
|
|
8 |
2/24 - 2/28 |
- CNN
- RNN
- Toolbox on CNN For Text Classification
|
|
Quiz 5 | week 6 and week 7| out 2/21 - due 2/28 |
|
9 |
3/03 - 3/07 |
- LSTM and GRU
- LSTM + Attention (Focus on Attention mechanism)
|
|
Quiz 6 | week 8| out 2/28 - due 3/07 |
|
10 |
3/10 - 3/14 |
- Transformer models
- Examples: BERT(Bidirectional Encoder Representations from Transformers) and GPT (Generative Pre-trained Transformer)
|
- HW3 due 3/14
- Note: You may submit HW3 without penalty until 3/21. Please note that this falls during Spring Break, so instructional support on Ed Discussion will be limited during that time.
|
Quiz 7 | week 9| out 3/07 - due 3/14 |
|
11 |
3/17 - 3/21 |
|
|
|
|
12 |
3/24 - 3/28 |
- Sequence Labelling: POS Tagging
- Sequen1e Labelling: NER
|
|
Quiz 8 | week 10| out 3/21 - due 3/28 |
|
13 |
3/31 - 4/04 |
- Unsupervised Models
- Topic Modeling (Latent Semantic Indexing, LDA (Latent Dirichlet Allocation)
|
|
Quiz 9 | week 12| out 3/28 - due 4/04 |
|
14 |
4/07 - 4/11 |
- Introduction to Generative AI
- Prompt Engineering Techniques
- Retrieval Augmented Generation (RAG)
|
|
Quiz 10 | week 13 | out 4/04 - due 4/11 |
|
15 |
4/14 - 4/18 |
- Toolbox on Exploring LLMs
|
- HW4 due 4/18
- Note: You may submit HW4 without penalty until 4/22.
|
Quiz 11 | week 14 | out 4/11 - due 4/18 |
|