Language Modeling: Assignment 3

In this assigment, you will build on your understanding of deep learning for language by building language models. We will ask you to implement and compare n-gram language models with transformer based ones.

The assignment requires you to fill in elements of a colab notebook, and then submit the notebook to GradeScope, along with the predictions of your models on test data. The Colab notebook, and write up template are below. In the past, we have asked you to respond to questions in the notebook. In this homework, all of the questions you need to respond to are in the write up document, including some new experiments. In the colab, all you need to do so pass the PennGrader tests.

Deliverables