pytorch/caffe2/python/operator_test
Maxime Boucher e2181a32ca Normalize rank loss gradient to avoid convergence issues when the number of pairs is really large
Summary:
Essentially, when number of pairs is around 1000, then only positive samples in the list gets a massive boost from all the negative examples. This diff normalizes the gradient and the loss with the number of pairs.

This diff also adds protection against NaN and more logging to help debug.

Reviewed By: kdub0

Differential Revision: D4359782

fbshipit-source-id: 7240344ddb1f2f670d1eec1b03e7f6e413f3dfcc
2016-12-21 17:29:24 -08:00
..
activation_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
atomic_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
checkpoint_test.py snapshot -> checkpoint 2016-12-15 12:01:30 -08:00
conv_test.py Make all convolution operators allow optional bias term 2016-12-21 15:14:24 -08:00
conv_transpose_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
copy_ops_test.py gradients for CopyGPUToCPU and CopyCPUToGPU + unit test + schema 2016-12-15 12:01:29 -08:00
cosine_embedding_criterion_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
counter_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
cross_entropy_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
dataset_ops_test.py Last N window collector 2016-12-15 12:01:30 -08:00
duplicate_operands_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
elementwise_op_broadcast_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
emptysample_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
extend_tensor_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
gather_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
gather_ranges_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
group_conv_test.py Make all convolution operators allow optional bias term 2016-12-21 15:14:24 -08:00
hsm_test.py HuffmanTreeHierarchy operator 2016-12-16 10:59:48 -08:00
index_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
margin_ranking_criterion_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
matmul_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
mkl_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
momentum_sgd_test.py MomemtumSGDUpdate -- version of MomentumSGD with update. 2016-12-15 12:01:29 -08:00
mpi_test.py Setup MPI before test start 2016-12-19 15:59:32 -08:00
one_hot_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
pack_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
partition_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
pooling_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
python_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
rank_loss_operator_test.py Normalize rank loss gradient to avoid convergence issues when the number of pairs is really large 2016-12-21 17:29:24 -08:00
record_queue_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
recurrent_network_test.py RNNs API simplification 2016-12-21 09:29:43 -08:00
relu_op_test.py MKLDevice and MKLOperator 2016-12-15 19:59:24 -08:00
reshape_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
segment_ops_test.py Incremental MeanReducer segment Ops 2016-11-29 15:18:38 -08:00
sequence_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
softmax_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
sparse_gradient_checker_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
sparse_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
spatial_bn_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
square_root_divide_op_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
string_ops_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00
text_file_reader_test.py Add unittest.main() lines to test scripts under python/operator_test 2016-11-29 15:18:37 -08:00