pytorch/test
oliver 3d358a7678 Adds a maximize flag to Adam (#68164)
Summary:
Solves the next most important use case in https://github.com/pytorch/pytorch/issues/68052.

I have kept the style as close to that in SGD as seemed reasonable, given the slight differences in their internal implementations.

All feedback welcome!

cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse SciPioneer H-Huang

Pull Request resolved: https://github.com/pytorch/pytorch/pull/68164

Reviewed By: VitalyFedyunin

Differential Revision: D32994129

Pulled By: albanD

fbshipit-source-id: 65c57c3f3dbbd3e3e5338d51def54482503e8850
2021-12-13 05:53:53 -08:00
..
ao/sparsity [sparsity] Convert function for sparse kernels without a context manager (#66778) 2021-12-09 02:58:57 -08:00
autograd
backward_compatibility [Jit] Fix schema of aten::split int[] version (#69745) 2021-12-10 02:33:36 -08:00
benchmark_utils
bottleneck_test
cpp Revert D32606547: torch/monitor: add C++ events and handlers 2021-12-11 22:51:03 -08:00
cpp_api_parity
cpp_extensions
custom_backend
custom_operator
distributed Adds a maximize flag to Adam (#68164) 2021-12-13 05:53:53 -08:00
distributions Add kl divergence between normal and laplace distribution. (#68807) 2021-12-01 10:22:08 -08:00
error_messages
expect Fixed type checking errors in node.py (#68124) 2021-12-03 12:03:49 -08:00
fx [const_fold] Fix call_module const folding (#68614) 2021-11-18 20:56:06 -08:00
fx2trt [fx2trt] Separate sign from trunc_div and use it for acc_ops.sign (#69486) 2021-12-06 16:54:44 -08:00
fx_acc
jit Populate runtime with upgrader graph (#68773) 2021-12-11 13:44:24 -08:00
jit_hooks
mobile [Operator Versioning][Edge] Add old models and unittest (#67726) 2021-12-01 18:46:30 -08:00
onnx [ONNX] shapeValueMap: Represent symbolic shape as value (#68203) (#69545) 2021-12-09 22:00:46 -08:00
package [package] fix torchscript classes in package (#68028) 2021-11-16 10:01:40 -08:00
quantization [quant][fx][graphmode] Move more patterns to use ModuleReLU fuse handler (#69644) 2021-12-11 22:00:06 -08:00
scripts
test_img
typing
delete.py
HowToWriteTestsUsingFileCheck.md
linear.py
run_test.py add python dispatch test back to CI and fix typo in test (#69565) 2021-12-08 08:44:49 -08:00
simulate_nccl_errors.py
test_ao_sparsity.py [sparsity] Fix and enable the pruning tests (#66411) 2021-11-22 15:28:12 -08:00
test_autocast.py
test_autograd.py Forward AD for inplace comparison operators (#69597) 2021-12-12 00:11:14 -08:00
test_binary_ufuncs.py Skips failing ROCm test (#69456) 2021-12-06 09:12:31 -08:00
test_bundled_images.py Add ownership to more edge tests (#67859) 2021-11-05 11:01:16 -07:00
test_bundled_inputs.py
test_complex.py
test_cpp_api_parity.py
test_cpp_extensions_aot.py
test_cpp_extensions_jit.py Remove remaining THC code (#69039) 2021-12-08 12:18:08 -08:00
test_cuda.py Fixes mem_get_info when querying on a device other than the current device (#69640) 2021-12-08 23:04:30 -08:00
test_cuda_primary_ctx.py
test_dataloader.py [DataLoader] Implementing communication processes for Map-style DataPipes (#68549) 2021-12-08 07:27:01 -08:00
test_datapipe.py [DataPipe] Adding output types to DataPipe interface file (#69647) 2021-12-10 12:04:45 -08:00
test_deploy.py
test_determination.py
test_dispatch.py
test_foreach.py Fix device type / dtype handling for parametrized test names (#65217) 2021-11-29 19:02:23 -08:00
test_function_schema.py
test_functional_autograd_benchmark.py
test_functional_optim.py
test_functionalization.py functionalization: update is_aliased() logic (#68881) 2021-12-02 09:19:12 -08:00
test_futures.py
test_fx.py FX: ensure node stack trace survives copying (#69368) 2021-12-07 06:18:38 -08:00
test_fx_experimental.py OpInfo for nn.functional.dropout2d, revise sample inputs for dropout (#67891) 2021-12-08 08:54:16 -08:00
test_gen_backend_stubs.py
test_import_stats.py
test_indexing.py Fixes CUDA vs CPU consistency for index_put_ when accumulating (part 2) (#67189) 2021-11-08 17:56:43 -08:00
test_jit.py Populate runtime with upgrader graph (#68773) 2021-12-11 13:44:24 -08:00
test_jit_autocast.py [JIT] additional support for CallMethod with autocasting (#67925) 2021-11-08 14:37:09 -08:00
test_jit_cuda_fuser.py Nvfuser code bump 11 5 (#67943) 2021-11-17 01:22:17 -08:00
test_jit_disabled.py
test_jit_fuser.py skip test_jit_legacy (#68129) 2021-11-10 23:08:32 -08:00
test_jit_fuser_legacy.py
test_jit_fuser_te.py [TensorExpr] Supress TracerWarnings in test_unsupported in test_jit_fuser_te.py. (#68757) 2021-11-30 00:06:36 -08:00
test_jit_legacy.py
test_jit_profiling.py
test_jit_simple.py
test_jit_string.py
test_kernel_launch_checks.py
test_license.py
test_linalg.py [Linalg] Add a runtime switch to let pytorch prefer a backend impl in linalg functions on GPU (#67980) 2021-12-03 19:06:30 -08:00
test_logging.py
test_masked.py Strided masked var. (#68738) 2021-12-01 19:19:37 -08:00
test_metal.py
test_mkldnn.py Avoid the view for mkldnn case in 1D convolution (#68166) 2021-11-15 11:56:45 -08:00
test_mobile_optimizer.py
test_model_dump.py Add ownership to more edge tests (#67859) 2021-11-05 11:01:16 -07:00
test_module_init.py [quant][embedding qat] eager mode QAT for Embeddings (#66429) 2021-11-18 05:57:11 -08:00
test_modules.py Add ModuleInfo-based device transfer tests (#68092) 2021-11-29 15:48:40 -08:00
test_multiprocessing.py
test_multiprocessing_spawn.py
test_namedtensor.py
test_namedtuple_return_api.py expose return_types in Python (#66614) 2021-12-06 09:05:29 -08:00
test_native_functions.py
test_nn.py Hook up general convolution to convolution_backward (#69584) 2021-12-12 17:30:01 -08:00
test_nnapi.py Add ownership to more edge tests (#67859) 2021-11-05 11:01:16 -07:00
test_numba_integration.py
test_numpy_interop.py
test_openmp.py
test_ops.py Do not test batched forward grad for inplace ops (#69558) 2021-12-12 00:09:45 -08:00
test_optim.py Adds a maximize flag to Adam (#68164) 2021-12-13 05:53:53 -08:00
test_overrides.py Add linalg.solve_triangular (#63568) 2021-11-22 12:41:06 -08:00
test_package.py
test_profiler.py record the datapipe for each pieces of Dataset (#67613) 2021-12-01 10:29:06 -08:00
test_pruning_op.py
test_public_bindings.py
test_python_dispatch.py add python dispatch test back to CI and fix typo in test (#69565) 2021-12-08 08:44:49 -08:00
test_pytree.py
test_quantization.py [quant][graphmode][fx] Fork subgraph_rewriter from torch.fx to quantization (#68228) 2021-11-24 10:49:05 -08:00
test_reductions.py Updated searchsorted functionality (#66818) 2021-11-05 12:13:47 -07:00
test_segment_reductions.py
test_serialization.py Avoid dtype mismatch error in torch.save if storages are unallocated (#68787) 2021-11-24 09:51:29 -08:00
test_set_default_mobile_cpu_allocator.py Add ownership to more edge tests (#67859) 2021-11-05 11:01:16 -07:00
test_shape_ops.py
test_show_pickle.py Add ownership to more edge tests (#67859) 2021-11-05 11:01:16 -07:00
test_sort_and_select.py Implement topk with sort for some cases (#68632) 2021-11-19 17:18:20 -08:00
test_sparse.py OpInfo: Allow sample_inputs_func to be any iterable (#69256) 2021-12-09 08:37:26 -08:00
test_sparse_csr.py OpInfo: Allow sample_inputs_func to be any iterable (#69256) 2021-12-09 08:37:26 -08:00
test_spectral_ops.py
test_stateless.py
test_static_runtime.py [static runtime][dper] multi_env tests for static runtime: selective enable (#67467) 2021-11-18 01:04:12 -08:00
test_tensor_creation_ops.py Add meta support to tensor range factories (#67032) 2021-11-05 15:36:29 -07:00
test_tensorboard.py
test_tensorexpr.py
test_tensorexpr_pybind.py
test_testing.py Fix device type / dtype handling for parametrized test names (#65217) 2021-11-29 19:02:23 -08:00
test_throughput_benchmark.py
test_torch.py [testing] Ignore expected_regex in assertRaisesRegex for non-native device (#68723) 2021-12-02 14:52:27 -08:00
test_type_hints.py
test_type_info.py
test_type_promotion.py
test_typing.py
test_unary_ufuncs.py The Jiterator (#69439) 2021-12-06 07:32:48 -08:00
test_utils.py Add support for C++ frontend wrapper on Linux (#69094) 2021-12-02 16:47:00 -08:00
test_view_ops.py Add some forward AD formulas (#69384) 2021-12-12 00:11:11 -08:00
test_vmap.py Add OpInfo test and fix a couple cases (#66294) 2021-11-19 14:31:03 -08:00
test_vulkan.py
test_xnnpack_integration.py Add ownership to more edge tests (#67859) 2021-11-05 11:01:16 -07:00