saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-15 21:01:19 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Create Modelcard for Reformer Model

Browse source
This commit is contained in:
Patrick von Platen 2020-04-15 16:26:24 +02:00 committed by GitHub
parent 01c37dcdb5
commit 301bf8d1b4
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
model_cards/patrickvonplaten/reformer-crime-and-punish/README.md Normal file
View file

@ -0,0 +1,4 @@
## Reformer Model trained on "Crime and Punishment"
Crime and Punishment text was taken from `gs://trax-ml/reformer/crime-and-punishment-2554.txt`.
Model was trained in flax using colab notebook proposed by authors: https://colab.research.google.com/github/google/trax/blob/master/trax/models/reformer/text_generation.ipynb
Weights were converted to Hugging Face PyTorch `ReformerModelWithLMHead`.