transformers/docs/source/en
JB (Don) f1a385b1de
[RoBERTa-based] Add support for sdpa (#30510)
* Adding SDPA support for RoBERTa-based models

* add not is_cross_attention

* fix copies

* fix test

* add minimal test for camembert and xlm_roberta as their test class does not inherit from ModelTesterMixin

* address some review comments

* use copied from

* style

* consistency

* fix lists

---------

Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
2024-08-28 10:26:00 +02:00
..
internal Forbid PretrainedConfig from saving generate parameters; Update deprecations in generate-related code 🧹 (#32659) 2024-08-23 11:12:53 +01:00
main_classes Add TorchAOHfQuantizer (#32306) 2024-08-14 16:14:24 +02:00
model_doc Granite language models (#31502) 2024-08-27 21:27:21 +02:00
quantization Add TorchAOHfQuantizer (#32306) 2024-08-14 16:14:24 +02:00
tasks [docs] Translation guide (#32547) 2024-08-08 13:43:14 -07:00
_config.py
_redirects.yml
_toctree.yml Granite language models (#31502) 2024-08-27 21:27:21 +02:00
accelerate.md
add_new_model.md
add_new_pipeline.md
agents.md Agents use grammar (#31735) 2024-08-07 11:42:52 +02:00
attention.md
autoclass_tutorial.md
benchmarks.md
bertology.md
big_models.md
chat_templating.md Update Jinja docs with new functions and general cleanup (#33097) 2024-08-23 17:40:06 +01:00
community.md
contributing.md
conversations.md [docs] change temperature to a positive value (#32077) 2024-07-23 17:47:51 +01:00
create_a_model.md Enable HF pretrained backbones (#31145) 2024-06-06 22:02:38 +01:00
custom_models.md Updated the custom_models.md changed cross_entropy code (#33118) 2024-08-26 13:15:43 +02:00
debugging.md
deepspeed.md Fix typos (#31819) 2024-07-08 11:52:47 +01:00
fast_tokenizers.md
fsdp.md
generation_strategies.md Docs: alert for the possibility of manipulating logits (#32467) 2024-08-07 16:34:46 +01:00
gguf.md
glossary.md Fix typos (#31819) 2024-07-08 11:52:47 +01:00
hpo_train.md
index.md Granite language models (#31502) 2024-08-27 21:27:21 +02:00
installation.md
kv_cache.md Cache: create docs (#32150) 2024-08-06 10:24:19 +05:00
llm_optims.md Cache: use batch_size instead of max_batch_size (#32657) 2024-08-16 11:48:45 +01:00
llm_tutorial.md Add SynCode to llm_tutorial (#32884) 2024-08-22 15:30:22 +02:00
llm_tutorial_optimization.md Fix typos (#31819) 2024-07-08 11:52:47 +01:00
model_memory_anatomy.md Very small change to one of the function parameters (#32548) 2024-08-27 09:29:05 -07:00
model_sharing.md Docs: formatting nits (#32247) 2024-07-30 15:49:14 +01:00
model_summary.md
multilingual.md
notebooks.md
pad_truncation.md
peft.md
perf_hardware.md Fix typos (#31819) 2024-07-08 11:52:47 +01:00
perf_infer_cpu.md
perf_infer_gpu_one.md [RoBERTa-based] Add support for sdpa (#30510) 2024-08-28 10:26:00 +02:00
perf_torch_compile.md fix(docs): Fixed a link in docs (#32274) 2024-07-29 10:50:43 +01:00
perf_train_cpu.md
perf_train_cpu_many.md Update the distributed CPU training on Kubernetes documentation (#32669) 2024-08-14 09:36:43 -07:00
perf_train_gpu_many.md Update perf_train_gpu_many.md (#31451) 2024-06-18 11:00:26 -07:00
perf_train_gpu_one.md Add torch_empty_cache_steps to TrainingArguments (#31546) 2024-07-04 13:20:49 -04:00
perf_train_special.md
perf_train_tpu_tf.md
performance.md
perplexity.md
philosophy.md
pipeline_tutorial.md Docs: Fixed whisper-large-v2 model link in docs (#32871) 2024-08-19 09:50:35 -07:00
pipeline_webserver.md
pr_checks.md
preprocessing.md chore: remove duplicate words (#31853) 2024-07-09 10:38:29 +01:00
quicktour.md docs: fix broken link (#31370) 2024-06-12 11:33:00 +01:00
run_scripts.md
sagemaker.md
serialization.md
task_summary.md
tasks_explained.md
testing.md Docs: Fixed WhisperModel.forward’s docstring link (#32498) 2024-08-07 11:01:33 -07:00
tf_xla.md fix(docs): Fixed a link in docs (#32274) 2024-07-29 10:50:43 +01:00
tflite.md
tokenizer_summary.md
torchscript.md
trainer.md Integrate Liger (Linkedin GPU Efficient Runtime) Kernel to Trainer (#32860) 2024-08-23 13:20:49 +02:00
training.md
troubleshooting.md