saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

tvm operator dynolog (#26295)

Browse source 
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/26295

Log the following in scuba caffe2_tvm_operator_stats:
1. everything in caffe2_operator_stats
2. fallback netdef
3. tvm module graph_json
4. whether compilation triggered this round
5. number of compilations stored in tvm_runtime_map
6. (not yet logged) last compilation time if any
7. (not yet logged) total bytes occupied by compilation
8. whether this compilation is fallback
9. batch size as observed by tvm op

Test Plan:
```
buck run mode/dbg //tvm/sparse:tvm_bbpredictor_benchmark -- --init_net ~/tmp/ads/84480054_204/init_net.pb --input_init_net ~/tmp/ads/84480054_204/input_init_net.pb --pred_net ~/tmp/ads/84480054_204/pred_net.pb --warmup 1000 --iter 1000 --num_cycles 5 --caffe2_logging_operator_dyno_sampling_rate=1 --vmodule=Logger=
2
```

Logs show up in the scuba:
https://our.intern.facebook.com/intern/scuba/query/?dataset=caffe2_tvm_operator_stats

https://fburl.com/scuba/lq2h22e4

Auto submitted adindexer canary:
https://our.intern.facebook.com/intern/ads/canary/421064436039494716
Additional adindexer canary:
https://our.intern.facebook.com/intern/ads/canary/421082681202831286/
Additional adfinder canary:
https://our.intern.facebook.com/intern/ads/canary/421082685084831037/

Reviewed By: yinghai

Differential Revision: D17358412

fbshipit-source-id: d2119c12ddeaa86217c163e32fb1e211952139f5
This commit is contained in:
Ansha Yu 2019-09-18 18:35:08 -07:00 committed by Facebook Github Bot
parent 36ade9aa23
commit e44ea6cd5e
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
caffe2/core/operator.h
View file

@ -532,6 +532,10 @@ class CAFFE2_API OperatorBase : public Observable<OperatorBase> {
}
}
virtual std::string debug_info_string() const {
return "";
}
inline const OperatorDef& debug_def() const {
CAFFE_ENFORCE(has_debug_def(), "operator_def was null!");
return *operator_def_;