transformers/tests
Matt 1c460a5273
TF port of the Segment Anything Model (SAM) (#22970)
* First commit

* Add auto-translation with GPT-4

* make fixup

* Add a functional layernorm for TF

* Add all the auxiliary imports etc.

* Add the extra processor and tests

* rebase to main

* Add all the needed fixes to the GPT code

* make fixup

* Make convolutions channels-last so they run on CPU

* make fixup

* Fix final issues

* Fix other models affected by test change

* Clarify comment on the sparse_prompt_embeddings check

* Refactor functional_layernorm, use shape_list in place of .shape in some places

* Remove deprecated torch-alike code

* Update tests/models/sam/test_modeling_tf_sam.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Update tests/models/sam/test_modeling_tf_sam.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Refactor processor with common methods and separated private methods

* make fixup

* Quietly delete the file that didn't do anything (sorry Sylvain)

* Refactor the processor tests into one file

* make fixup

* Clean up some unnecessary indirection

* Fix TF mask postprocessing

* Add more processor equivalence tests

* Refactor generate_crop_boxes to use framework-neutral np code

* Make the serving output correctly conditional

* Fix error message line length

* Use dict keys rather than indices internally in both TF and PT SAM call/forward

* Return dicts internally in the call/forward methods

* Revert changes to common tests and just override check_pt_tf_outputs

* Revert changes to other model tests

* Clarify comments for functional layernorm

* Add missing transpose from PT code

* Removed unused copied from in PT code

* Remove overrides for tests that don't exist in TF

* Fix transpose and update tests for PT and TF to check pred_masks

* Add training flag

* Update tests to use TF checkpoints

* Update index.mdx

* Add missing cross-test decorator

* Remove optional extra asterisks

* Revert return_dict changes in PT code

* Update src/transformers/models/sam/modeling_tf_sam.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Remove None return annotations on init methods

* Update tests/models/sam/test_processor_sam.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Fix input_boxes shapes

* make fixup

---------

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-05-19 14:14:13 +01:00
..
benchmark
bettertransformer Add methods to PreTrainedModel to use PyTorch's BetterTransformer (#21259) 2023-04-27 11:03:42 +02:00
deepspeed Fix decorator order (#22708) 2023-04-11 17:59:15 +02:00
extended [tests] switch to torchrun (#22712) 2023-04-12 08:25:45 -07:00
fixtures [WIP] add SpeechT5 model (#18922) 2023-02-03 12:43:46 -05:00
generation Less flaky test_assisted_decoding_matches_greedy_search (#23451) 2023-05-18 17:28:22 +02:00
mixed_int8 [bnb] Let's make serialization of int8 models possible (#22177) 2023-04-12 08:01:18 -04:00
models TF port of the Segment Anything Model (SAM) (#22970) 2023-05-19 14:14:13 +01:00
onnx Fix issue introduced in PR #23163 (#23363) 2023-05-15 11:38:44 +02:00
optimization Make schedulers picklable by making lr_lambda fns global (#21768) 2023-03-02 12:08:43 -05:00
pipelines Fix (skip) a pipeline test for RwkvModel (#23444) 2023-05-18 14:54:23 +02:00
repo_utils Test fetch v2 (#22367) 2023-03-31 16:18:43 -04:00
sagemaker Avoid invalid escape sequences, use raw strings (#22936) 2023-04-25 09:17:56 -04:00
tokenization Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
tools Fix image segmentation tool test (#23306) 2023-05-11 14:38:11 -04:00
trainer Add Trainer support for ReduceLROnPlateau (#23010) 2023-04-28 09:17:30 -04:00
utils Update tiny models and pipeline tests (#23446) 2023-05-18 17:29:04 +02:00
__init__.py
test_backbone_common.py Add methods to update and verify out_features out_indices (#23031) 2023-05-04 10:15:06 +01:00
test_configuration_common.py Add RWKV-4 (#22797) 2023-05-09 13:04:10 -04:00
test_feature_extraction_common.py Prepare tests for hfh 0.14 (#22958) 2023-04-24 09:31:50 -04:00
test_image_processing_common.py Prepare tests for hfh 0.14 (#22958) 2023-04-24 09:31:50 -04:00
test_image_transforms.py Rescale image back if it was scaled during PIL conversion (#22458) 2023-03-30 11:29:11 +01:00
test_modeling_common.py [AutoModel] fix torch_dtype=auto in from_pretrained (#23379) 2023-05-16 10:21:42 -07:00
test_modeling_flax_common.py Fix bigbird random attention (#21023) 2023-04-27 13:52:28 -04:00
test_modeling_tf_common.py Make _test_xla_generate less flaky (#22996) 2023-04-28 13:27:28 +02:00
test_pipeline_mixin.py Update tiny models and pipeline tests (#23446) 2023-05-18 17:29:04 +02:00
test_sequence_feature_extraction_common.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
test_tokenization_common.py chore: allow protobuf 3.20.3 requirement (#22759) 2023-05-10 20:22:56 +02:00