Tensors and Dynamic neural networks in Python with strong GPU acceleration
Find a file
Martin Raison ea9a0f24bf automatic aggregation of sparse gradients
Summary:
This adds support for automatic aggregation of sparse gradients. We simply concatenate indices and values (no attempt to deduplicate, since this is already done before feeding into the optimizer). This should support various cases (indices and/or values can be generated by one or more gradient ops, or gradient outputs can be directly passed from inputs).

I tried to minimize the code footprint, but I introduced SparseGradGenMeta because GradGenMeta didn't lend itself very well to be used with sparse gradients.

Reviewed By: dzhulgakov

Differential Revision: D4219788

fbshipit-source-id: 1d074664cffd82a8764e4b1473ada6bc46e6c51a
2016-12-05 11:53:26 -08:00
caffe/proto more build updates: 2016-08-02 23:28:23 -07:00
caffe2 automatic aggregation of sparse gradients 2016-12-05 11:53:26 -08:00
docs chunky sync 2016-05-13 14:43:48 -07:00
third_party nervana build files 2016-10-07 18:37:26 -07:00
.Doxyfile Adding optional Eigen code. Added a switch USE_SYSTEM_EIGEN in Env. Misc changes. 2015-10-18 16:55:24 -07:00
.gitignore Adding optional Eigen code. Added a switch USE_SYSTEM_EIGEN in Env. Misc changes. 2015-10-18 16:55:24 -07:00
.gitmodules nervana build files 2016-10-07 18:37:26 -07:00
build.py nervana build files 2016-10-07 18:37:26 -07:00
build_android.py fbsync 2016-10-07 15:47:52 -07:00
build_android_prepare.py fbsync 2016-10-07 15:47:52 -07:00
LICENSE fbsync. TODO: check if build files need update. 2016-11-15 00:00:46 -08:00
Makefile more build updates: 2016-08-02 23:28:23 -07:00
README.md removed deprecated readme info 2016-11-18 17:03:20 -08:00

Caffe2

Caffe2 is a deep learning framework made with expression, speed, and modularity in mind. It is an experimental refactoring of Caffe, and allows a more flexible way to organize computation.

Read the installation instructions for installation details.

License and Citation

Caffe2 is released under the BSD 2-Clause license.