From 301bf8d1b43d99efe1fdb5ba15871e975b3cb6cf Mon Sep 17 00:00:00 2001 From: Patrick von Platen Date: Wed, 15 Apr 2020 16:26:24 +0200 Subject: [PATCH] Create Modelcard for Reformer Model --- .../patrickvonplaten/reformer-crime-and-punish/README.md | 4 ++++ 1 file changed, 4 insertions(+) create mode 100644 model_cards/patrickvonplaten/reformer-crime-and-punish/README.md diff --git a/model_cards/patrickvonplaten/reformer-crime-and-punish/README.md b/model_cards/patrickvonplaten/reformer-crime-and-punish/README.md new file mode 100644 index 000000000..b69644f4b --- /dev/null +++ b/model_cards/patrickvonplaten/reformer-crime-and-punish/README.md @@ -0,0 +1,4 @@ +## Reformer Model trained on "Crime and Punishment" +Crime and Punishment text was taken from `gs://trax-ml/reformer/crime-and-punishment-2554.txt`. +Model was trained in flax using colab notebook proposed by authors: https://colab.research.google.com/github/google/trax/blob/master/trax/models/reformer/text_generation.ipynb +Weights were converted to Hugging Face PyTorch `ReformerModelWithLMHead`.