saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-14 20:58:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
transformers/src/transformers
History
Jin Young Sohn b231a413f5
Add cache_dir to save features in GLUE + Differentiate match/mismatch for MNLI metrics (#4621) 
* Glue task cleaup

* Enable writing cache to cache_dir in case dataset lives in readOnly
filesystem.
* Differentiate match vs mismatch for MNLI metrics.

* Style

* Fix pytype

* Fix type

* Use cache_dir in mnli mismatch eval dataset

* Small Tweaks

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-06-02 13:40:14 -04:00
..
benchmark [Benchmark] Memory benchmark utils (#4198) 2020-05-27 23:22:16 +02:00
commands Make transformers-cli cross-platform (#4131) 2020-05-26 10:00:51 -04:00
data Add cache_dir to save features in GLUE + Differentiate match/mismatch for MNLI metrics (#4621) 2020-06-02 13:40:14 -04:00
__init__.py Release: v2.11.0 2020-06-02 09:49:09 -04:00
activations.py Allow gpt2 to be exported to valid ONNX (#4244) 2020-05-11 14:55:55 -04:00
configuration_albert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_auto.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_bart.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_bert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_camembert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_ctrl.py Fix CI after killing archive maps (#4724) 2020-06-02 10:21:09 -04:00
configuration_distilbert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_electra.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_encoder_decoder.py add examples to doc (#4045) 2020-04-28 16:33:23 +02:00
configuration_flaubert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_gpt2.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_longformer.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_marian.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_mmbt.py
configuration_openai.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_reformer.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_roberta.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_t5.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_transfo_xl.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_utils.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_xlm.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_xlm_roberta.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
configuration_xlnet.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
convert_albert_original_tf_checkpoint_to_pytorch.py Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057) 2020-05-07 19:44:51 -04:00
convert_bart_original_pytorch_checkpoint_to_pytorch.py Fix CI after killing archive maps (#4724) 2020-06-02 10:21:09 -04:00
convert_bert_original_tf_checkpoint_to_pytorch.py
convert_bert_pytorch_checkpoint_to_original_tf.py
convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py [dialogpt] conversion script 2020-03-10 15:09:29 -04:00
convert_electra_original_tf_checkpoint_to_pytorch.py ELECTRA (#3257) 2020-04-03 14:10:54 -04:00
convert_gpt2_original_tf_checkpoint_to_pytorch.py
convert_graph_to_onnx.py Fix onnx export input names order (#4641) 2020-06-01 16:12:48 +02:00
convert_longformer_original_pytorch_lightning_to_pytorch.py [Longformer For Question Answering] Conversion script, doc, small fixes (#4593) 2020-05-26 14:58:47 +02:00
convert_marian_to_pytorch.py Fix: unpin flake8 and fix cs errors (#4367) 2020-05-14 13:14:26 -04:00
convert_openai_original_tf_checkpoint_to_pytorch.py
convert_pytorch_checkpoint_to_tf2.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
convert_reformer_trax_checkpoint_to_pytorch.py [Reformer] Add Enwiki8 Reformer Model - Adapt convert script (#4282) 2020-05-11 16:38:07 +02:00
convert_roberta_original_pytorch_checkpoint_to_pytorch.py Fix roberta checkpoint conversion script (#3642) 2020-04-07 12:03:23 -04:00
convert_t5_original_tf_checkpoint_to_pytorch.py
convert_transfo_xl_original_tf_checkpoint_to_pytorch.py
convert_xlm_original_pytorch_checkpoint_to_pytorch.py
convert_xlnet_original_tf_checkpoint_to_pytorch.py
file_utils.py [Benchmark] Memory benchmark utils (#4198) 2020-05-27 23:22:16 +02:00
hf_api.py [model upload] Support for organizations 2020-03-09 17:33:57 -04:00
hf_argparser.py [Benchmark] Memory benchmark utils (#4198) 2020-05-27 23:22:16 +02:00
modelcard.py CDN urls (#4030) 2020-04-28 20:27:14 -04:00
modeling_albert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_auto.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_bart.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_bert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_camembert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_ctrl.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_distilbert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_electra.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_encoder_decoder.py [EncoderDecoder] Fix initialization and save/load bug (#4680) 2020-05-30 01:25:19 +02:00
modeling_flaubert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_gpt2.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_longformer.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_marian.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_mmbt.py Add nn.Module as superclass (#4533) 2020-05-25 15:29:33 -04:00
modeling_openai.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_reformer.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_roberta.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_t5.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_albert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_auto.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_bert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_camembert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_ctrl.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_distilbert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_electra.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_flaubert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_gpt2.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_openai.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_pytorch_utils.py Support T5 Generation (#3228) 2020-03-19 23:18:23 +01:00
modeling_tf_roberta.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_t5.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_transfo_xl.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_transfo_xl_utilities.py
modeling_tf_utils.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_xlm.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_xlm_roberta.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_tf_xlnet.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_transfo_xl.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_transfo_xl_utilities.py Shift labels internally within TransfoXLLMHeadModel when called with labels (#3716) 2020-04-13 18:11:23 +02:00
modeling_utils.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_xlm.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_xlm_roberta.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
modeling_xlnet.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
optimization.py 🚨 Remove warning of deprecation (#4477) 2020-05-20 16:48:29 -04:00
optimization_tf.py Correct TF formatting to exclude LayerNorms from weight decay (#4448) 2020-05-20 16:45:59 -04:00
pipelines.py Fix CI after killing archive maps (#4724) 2020-06-02 10:21:09 -04:00
tokenization_albert.py Fix special token doc (#4292) 2020-05-11 15:05:36 -04:00
tokenization_auto.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
tokenization_bart.py Fix CI after killing archive maps (#4724) 2020-06-02 10:21:09 -04:00
tokenization_bert.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
tokenization_bert_japanese.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
tokenization_camembert.py Fix special token doc (#4292) 2020-05-11 15:05:36 -04:00
tokenization_ctrl.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_distilbert.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_electra.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_flaubert.py Fix CI after killing archive maps (#4724) 2020-06-02 10:21:09 -04:00
tokenization_gpt2.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_longformer.py [Longformer] more models + model cards (#4628) 2020-05-28 11:11:05 +02:00
tokenization_marian.py [MarianTokenizer] implement save_vocabulary and other common methods (#4389) 2020-05-19 19:45:49 -04:00
tokenization_openai.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_reformer.py Reformer (#3351) 2020-05-07 10:17:01 +02:00
tokenization_roberta.py Fix convert_token_type_ids_from_sequences for fast tokenizers (#4503) 2020-05-22 12:45:10 -04:00
tokenization_t5.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_transfo_xl.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
tokenization_utils.py Kill model archive maps (#4636) 2020-06-02 09:39:33 -04:00
tokenization_xlm.py Fix special token doc (#4292) 2020-05-11 15:05:36 -04:00
tokenization_xlm_roberta.py Fix special token doc (#4292) 2020-05-11 15:05:36 -04:00
tokenization_xlnet.py Fix special token doc (#4292) 2020-05-11 15:05:36 -04:00
trainer.py Add cache_dir to save features in GLUE + Differentiate match/mismatch for MNLI metrics (#4621) 2020-06-02 13:40:14 -04:00
trainer_tf.py Better None gradients handling in TF Trainer (#4469) 2020-05-20 16:46:21 -04:00
trainer_utils.py TF version of the trainer (#4017) 2020-05-06 12:56:52 -04:00
training_args.py per_device instead of per_gpu/error thrown when argument unknown (#4618) 2020-05-27 11:36:55 -04:00
training_args_tf.py Question Answering for TF trainer (#4320) 2020-05-13 09:22:31 -04:00