DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter.

Tue, 01 Jan 2019 00:00:00 +0100

Victor Sanh, Lysandre Debut, Julien Chaumond, Thomas Wolf:
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. CoRR abs/1910.01108 (2019)