Notes

Introducing transfer learning in NLP

Wikitext 103 corpus

TextDataBunch class

There is a difference between TextDataBunch and TextData

Tokenization → Vocabulary → Numericalization

Didn't understand the label for language model part

language_model_learner

Behind the scenes, it wouldn't create a cnn - but it will create a RNN

Text classifier learning

there is a difference between language model learner and text classifier learner

drop_mult is the parameter that handles the regularization

Unfreezing layer by layer for nlp

building models to find out values for hyper parameters → AutoML 👍