saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-15 21:01:19 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
transformers/docs/source/model_doc
History
Yih-Dar 8f2cc1c3ab
Add TFCLIPModel (#13967) 
* Start the work for TFCLIPModel

* Convert to TF code (TODO: loss + doc)

* Clean up

* Fix pooled_output for TFCLIPTextTransformer - using tf.gather_nd

* assert -> raise error

* Expose TFCLIPModel

* Deal with dummy_inputs

* Add tests

* Fix all tests. TODO: manual check weight loading + add more comments

* Fix pt tf equivalence test

* fixes

* update TFCLIPVisionEmbeddings's Conv2D

* Fix loss + overwrite test_pt_tf_model_equivalence from common

* Add a comment about the change about MainLayer in test_keras_save_load

* Set return_loss=True in TFCLIPModelTester + make tests pass

* overwrite test_pt_tf_model_equivalence from tf common

* fix base_model_prefix

* Fix examples

* remove unused

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply review suggestions

* change self.pre_layrnorm to self.pre_layernorm

* apply more review suggestions

* return attention probs before dropout (to align with PT)

* fix weight init

* fix

* build doc

* fix missing doc

* fix for test

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-12-23 11:19:44 -05:00
..
albert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
auto.rst Add Speaker Diarization and Verification heads (#14723) 2021-12-16 19:22:14 +03:00
bart.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
barthez.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bartpho.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
beit.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bert.mdx Convert rst to mdx bert (#14806) 2021-12-17 11:13:34 -05:00
bert_japanese.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bertgeneration.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bertweet.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bigbird.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bigbird_pegasus.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
blenderbot.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
blenderbot_small.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
bort.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
byt5.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
camembert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
canine.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
clip.mdx Add TFCLIPModel (#13967) 2021-12-23 11:19:44 -05:00
convbert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
cpm.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
ctrl.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
deberta.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
deberta_v2.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
deit.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
detr.mdx Doc new front (#14590) 2021-12-01 14:13:02 -05:00
dialogpt.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
distilbert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
dpr.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
electra.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
encoderdecoder.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
flaubert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
fnet.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
fsmt.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
funnel.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
gpt.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
gpt2.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
gpt_neo.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
gptj.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
herbert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
hubert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
ibert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
imagegpt.mdx Improve documentation of some models (#14695) 2021-12-13 13:24:36 +01:00
layoutlm.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
layoutlmv2.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
layoutxlm.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
led.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
longformer.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
luke.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
lxmert.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
m2m_100.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
marian.mdx Convert model files from rst to mdx (#14865) 2021-12-22 03:27:30 -05:00
mbart.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
megatron_bert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
megatron_gpt2.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
mluke.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
mobilebert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
mpnet.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
mt5.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
pegasus.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
perceiver.mdx Fix Perceiver docs (#14879) 2021-12-22 14:18:03 +01:00
phobert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
prophetnet.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
qdqbert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
rag.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
reformer.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
rembert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
retribert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
roberta.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
roformer.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
segformer.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
sew.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
sew_d.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
speech_to_text.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
speech_to_text_2.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
speechencoderdecoder.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
splinter.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
squeezebert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
t5.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
t5v1.1.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
tapas.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
transformerxl.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
trocr.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
unispeech.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
unispeech_sat.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
vision_text_dual_encoder.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
visionencoderdecoder.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
visual_bert.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
vit.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
wav2vec2.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
wav2vec2_phoneme.mdx Wav2Vec2 meets phonemes (#14353) 2021-12-17 19:56:44 +01:00
wavlm.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
xlm.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
xlmprophetnet.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
xlmroberta.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
xlnet.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
xls_r.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
xlsr_wav2vec2.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00