pytorch/caffe2/python
Bram Wasti aa56a1211d
Update from facebook (#6871)
* Track checkpoint performance in scuba

As title.

* [C2/CUDA]: fix cross entropy sigmoid with logits

when adding log_d_trick, I forgot to add it to the cuda impl; this diff fixes
it.

* Back out "[caffe2] Unregister MKL fallbacks for NCHW conversions"

Original commit changeset: 8918dd40205a
Will land after @jongsoo's diff https://phabricator.intern.facebook.com/D7596315 lands

* [Easy][C2] Don't add blob to external outputs from output_record if it's already external output

As desc.

* On Mobile phones, call GlobalInit with no arguments in predictor in case we need to perform initialization

FACEBOOK:

The QPL logger needs the initialization code. In the past, the initialization code is put in the pipeline calling Caffe2. However, those places become obsolete quickly, as the product teams change places to call Caffe2 from time to time. We also need to track which teams use Caffe2 so that we can put the initialization code there.

With this diff, the initialization code is put in the predictor constructor, only enabled for mobile phones. This way, we can always enable QPL logging.

Once we do this, we can check how many times Caffe2 inference is called in production, and which models are more popular in production. This way, we can prioritize our effort supporting those models.

Will clean up the old code calling the init in the product in a separate diff.

* add padding op for sparse length tensor

to pad length-based sparse tensor with padding_value

* Add conv_op with cudaconvnet engine

Add conv_op with cudaconvnet engine

* [numa] Fix simple NUMA copy benchmark

Move XavierFill into init_net and also compute BW

* call roundf (device function) instead of round (host function)

* [caffe2_benchmark][observer] Make caffe2_benchmark use its own observer

1. Add ClearGlobalNetObservers()
2. Make caffe2_benchmark use its own observer and observer_reporter

* [detectron] Use roundf instead of round in the detectron module ops

* allow K larger than number of elements in top k op

one use case is to use this op together with PackSegments for sparse tensors, where the number of elements in each slice is not statistically defined.

* add ChannelShuffle DNNLOWP op

* fixup math_cpu.cc break
2018-04-23 15:01:56 -07:00
..
docs Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
examples Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
helpers [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
ideep [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
layers Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
mint Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
mkl Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
modeling Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
models Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
onnx Quick patch for the CI (#6802) 2018-04-20 08:58:38 -07:00
operator_test Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
predictor Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
rnn Fix a typo 2018-03-30 21:00:44 -07:00
test Fix occasional test timeouts 2018-01-19 20:08:58 -08:00
trt [Caffe2] Provide option to initialize the TensorRT engine at Operator constructor time (#6809) 2018-04-23 13:09:35 -07:00
__init__.py Experimental support for setup.py develop mode install 2018-02-12 23:36:18 -08:00
_import_c_extension.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
allcompare_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
attention.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
benchmark_generator.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
binarysize.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
brew.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
brew_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
build.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
cached_reader.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
caffe_translator.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
caffe_translator_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
checkpoint.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
checkpoint_test.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
CMakeLists.txt [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
cnn.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
context_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control_ops_grad.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control_ops_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
convnet_benchmarks.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
convnet_benchmarks_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
core.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
core_gradients_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
core_test.py Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
crf.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
data_parallel_model.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
data_parallel_model_test.py Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
data_workers.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
data_workers_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
dataio.py Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
dataio_test.py Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
dataset.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
db_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
device_checker.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
dlpack.h
dyndep.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
embedding_generation_benchmark.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
experiment_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
extension_loader.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
functional.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
functional_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
fused_8bit_rowwise_conversion_ops_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
gradient_check_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
gradient_checker.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
gru_cell.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
hsm_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
hypothesis_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
hypothesis_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
ideep_test_util.py [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
layer_model_helper.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
layer_model_instantiator.py [caffe2] Fbcode to GitHub sync (#6208) 2018-04-02 16:35:27 -07:00
layer_parameter_sharing_test.py [layer model] remove duplicated init ops 2018-03-27 18:10:39 -07:00
layer_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
layers_test.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
lengths_reducer_fused_8bit_rowwise_ops_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
lengths_reducer_rowwise_8bit_ops_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
lstm_benchmark.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
memonger.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
memonger_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
mkl_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
model_device_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
model_helper.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
modifier_context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
mpi_python.cc Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
muji.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
muji_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_builder.py Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
net_builder_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_drawer.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_printer.py [DT] [38/n] Rename add_stop_signal to add_stop_condition (#6825) 2018-04-23 10:39:37 -07:00
net_printer_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
numa_benchmark.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
numa_test.py [core] NUMA-aware pinned allocator 2018-03-06 00:33:11 -08:00
observer_test.py Fix RNN scoping situation 2018-02-07 17:35:29 -08:00
optimizer.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
optimizer_context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
optimizer_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
optimizer_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
parallel_workers.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
parallel_workers_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
parallelize_bmuf_distributed_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pipeline.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pipeline_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
predictor_constants.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state.cc [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
pybind_state.h [Caffe2] Workspace centric API for TensorRT transformation (#6678) 2018-04-17 21:23:27 -07:00
pybind_state_dlpack.cc Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state_dlpack.h Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state_gpu.cc [Caffe2] Provide option to initialize the TensorRT engine at Operator constructor time (#6809) 2018-04-23 13:09:35 -07:00
pybind_state_ideep.cc [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
pybind_state_int8.cc [C2 Int8][C2 Core]fetch int8 blob 2018-03-30 21:00:44 -07:00
pybind_state_mkl.cc Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
python_op_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
queue_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
record_queue.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
recurrent.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
regularizer.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
regularizer_context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
regularizer_test.py
rnn_cell.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
schema.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
schema_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
scope.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
scope_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
session.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
session_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
sparse_to_dense_mask_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
sparse_to_dense_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
task.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
text_file_reader.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
timeout_guard.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
toy_regression_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
transformations.py Add fuseNNPACKConvRelu (#6439) 2018-04-10 16:51:16 -07:00
transformations_test.py Add fuseNNPACKConvRelu (#6439) 2018-04-10 16:51:16 -07:00
tt_core.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
tt_core_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
utils.py [layer model] remove duplicated init ops 2018-03-27 18:10:39 -07:00
visualize.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
workspace.py change print to logger.warning in operator traceback code (#6216) 2018-04-03 08:01:25 -07:00
workspace_test.py [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00