pytorch/caffe2/python/examples
Alexander Sidorov 2ce3cfefe1 Char-RNN Tutorial
Summary:
This learns Shakespeare and then generates samples one character at a time. We want this to be an example of using our LSTM and RNNs in general.

Now it takes 4ms to run the training net on current parameters (with batch size = 1). I don't have data on how much each operator takes yet. But overal python loop doesn't seem to influence much - with 1000 fake iterations in run_net it took 4s for each iteration as expected.

Future work:

* fixing convergence for batching
* profiling on operator level
* trying it out with GPUs
* benchmarking against  existing char-rnn implementations
* stacking lstms (one lstm is different from two, one needs to take care of scoping)

Reviewed By: urikz

Differential Revision: D4430612

fbshipit-source-id: b36644fed9844683f670717d57f8527c25ad285c
2017-02-02 15:44:32 -08:00
..
char_rnn.py Char-RNN Tutorial 2017-02-02 15:44:32 -08:00
lmdb_create_example.py LMDB example 2016-12-05 11:53:26 -08:00
resnet50_trainer.py Gradient Input memory sharing using memonger blob sharing 2017-01-09 19:44:23 -08:00