•attention

Please look at Instructions.png for further instructions, but in summary: You will be designing and training a language model on the Penn Treebank and write a 1-2 page report on it (using the ACL stuff) For the model, you can make use of •RNN, LSTM, GRU, etc....

• hyperparameter tuning

For this assignment, you will be designing and training a language model on the Penn Treebank (text-only), that is an unsupervised learning model. Here are some things you may try: RNN, LSTM, GRU, etc. • Attention (covering next week) • Different tokenizers •...

•regularization, dropout, etc.

Please look at Instructions.png for further instructions, but in summary: You will be designing and training a language model on the Penn Treebank and write a 1-2 page report on it (using the ACL stuff) For the model, you can make use of •RNN, LSTM, GRU, etc....