mirror of
https://github.com/saymrwulf/transformers.git
synced 2026-05-14 20:58:08 +00:00
4ef0abb738
* Add TapexTokenizer * Improve docstrings and provide option to provide answer * Remove option for pretokenized inputs * Add TAPEX to README * Fix copies * Remove option for pretokenized inputs * Initial commit: add tapex fine-tuning examples on both table-based question answering and table-based fact verification. * - Draft a README file for running the script and introducing some background. - Remove unused code lines in tabfact script. - Disable the deafult `pad_to_max_length` option which is memory-consuming. * * Support `as_target_tokenizer` function for TapexTokenizer. * Fix the do_lower_case behaviour of TapexTokenizer. * Add unit tests for target scenarios and cased/uncased scenarios for both source and target. * * Replace the label BartTokenizer with TapexTokenizer's as_target_tokenizer function. * Fix typos in tapex example README. * * fix the evaluation script - remove the property `task_name` * * Make the label space more clear for tabfact tasks * * Using a new fine-tuning script for tapex-base on tabfact. * * Remove the lowercase code outside the tokenizer - we use the tokenizer to control whether do_lower_case * Guarantee the hyper-parameter can be run without out-of-memory on 16GB card and report the new reproduced number on wikisql * * Remove the default tokenizer_name option. * Provide evaluation command. * * Support for WikiTableQuestion dataset. * Fix a typo in README. * * Fix the datasets's key name in WikiTableQuestions * Run make fixup and move test to folder * Fix quality * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Suraj Patil <surajp815@gmail.com> * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * Apply some more suggestions from code review * Improve docstrings * Overwrite failing test * Improve comment in example scripts * Fix rebase * Add TAPEX to Auto mapping * Add TAPEX to auto config mappings * Put TAPEX higher than BART in auto mapping * Add TAPEX to doc tests Co-authored-by: Niels Rogge <nielsrogge@Nielss-MBP.localdomain> Co-authored-by: SivilTaram <qianlxc@outlook.com> Co-authored-by: Niels Rogge <nielsrogge@nielss-mbp.home> Co-authored-by: Suraj Patil <surajp815@gmail.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local> |
||
|---|---|---|
| .. | ||
| albert.mdx | ||
| auto.mdx | ||
| bart.mdx | ||
| barthez.mdx | ||
| bartpho.mdx | ||
| beit.mdx | ||
| bert-generation.mdx | ||
| bert-japanese.mdx | ||
| bert.mdx | ||
| bertweet.mdx | ||
| big_bird.mdx | ||
| bigbird_pegasus.mdx | ||
| blenderbot-small.mdx | ||
| blenderbot.mdx | ||
| bort.mdx | ||
| byt5.mdx | ||
| camembert.mdx | ||
| canine.mdx | ||
| clip.mdx | ||
| convbert.mdx | ||
| convnext.mdx | ||
| cpm.mdx | ||
| ctrl.mdx | ||
| data2vec.mdx | ||
| deberta-v2.mdx | ||
| deberta.mdx | ||
| decision_transformer.mdx | ||
| deit.mdx | ||
| detr.mdx | ||
| dialogpt.mdx | ||
| distilbert.mdx | ||
| dit.mdx | ||
| dpr.mdx | ||
| dpt.mdx | ||
| electra.mdx | ||
| encoder-decoder.mdx | ||
| flaubert.mdx | ||
| fnet.mdx | ||
| fsmt.mdx | ||
| funnel.mdx | ||
| glpn.mdx | ||
| gpt2.mdx | ||
| gpt_neo.mdx | ||
| gptj.mdx | ||
| herbert.mdx | ||
| hubert.mdx | ||
| ibert.mdx | ||
| imagegpt.mdx | ||
| layoutlm.mdx | ||
| layoutlmv2.mdx | ||
| layoutxlm.mdx | ||
| led.mdx | ||
| longformer.mdx | ||
| luke.mdx | ||
| lxmert.mdx | ||
| m2m_100.mdx | ||
| marian.mdx | ||
| maskformer.mdx | ||
| mbart.mdx | ||
| megatron-bert.mdx | ||
| megatron_gpt2.mdx | ||
| mluke.mdx | ||
| mobilebert.mdx | ||
| mpnet.mdx | ||
| mt5.mdx | ||
| nystromformer.mdx | ||
| openai-gpt.mdx | ||
| pegasus.mdx | ||
| perceiver.mdx | ||
| phobert.mdx | ||
| plbart.mdx | ||
| poolformer.mdx | ||
| prophetnet.mdx | ||
| qdqbert.mdx | ||
| rag.mdx | ||
| realm.mdx | ||
| reformer.mdx | ||
| regnet.mdx | ||
| rembert.mdx | ||
| resnet.mdx | ||
| retribert.mdx | ||
| roberta.mdx | ||
| roformer.mdx | ||
| segformer.mdx | ||
| sew-d.mdx | ||
| sew.mdx | ||
| speech-encoder-decoder.mdx | ||
| speech_to_text.mdx | ||
| speech_to_text_2.mdx | ||
| splinter.mdx | ||
| squeezebert.mdx | ||
| swin.mdx | ||
| t5.mdx | ||
| t5v1.1.mdx | ||
| tapas.mdx | ||
| tapex.mdx | ||
| transfo-xl.mdx | ||
| trocr.mdx | ||
| unispeech-sat.mdx | ||
| unispeech.mdx | ||
| van.mdx | ||
| vilt.mdx | ||
| vision-encoder-decoder.mdx | ||
| vision-text-dual-encoder.mdx | ||
| visual_bert.mdx | ||
| vit.mdx | ||
| vit_mae.mdx | ||
| wav2vec2.mdx | ||
| wav2vec2_phoneme.mdx | ||
| wavlm.mdx | ||
| xglm.mdx | ||
| xlm-prophetnet.mdx | ||
| xlm-roberta-xl.mdx | ||
| xlm-roberta.mdx | ||
| xlm.mdx | ||
| xlnet.mdx | ||
| xls_r.mdx | ||
| xlsr_wav2vec2.mdx | ||
| yoso.mdx | ||