onnxruntime/onnxruntime/contrib_ops
Dmitri Smirnov 058803086d
Implement N-gram (#180)
* Implement N-gram
  Do not load unnecessary pool n-grams. Add String typed tests.
  Set output size to the mav ngram_index value plus 1.

* Address security warnings and some review comments.

* Fix build issues, rework sampling to try all n-gram sizes at a given offset.

* Rework the loop so all n should be tried at a given offset
  and we do not add the same items all over again such as
  b,c and next we try b,c,d but we no longer add b,c again.

* Compute hash incrementally so we do not re-hash elements that were
  already there when we add more elements to n-gram.

* Address review comments.
  TODO: Remove all attribute.

* Remove all attribute, adjust tests. Correct docs.

* Address more review comments.

* Create Type And Shape inference function.

* Address review comments. Implement batch mode per new spec.

* Correct switch bracing in OutputResult and re-test.

* Fix shape error message within TypeAndShapeInferenceFunction.
2019-01-03 16:21:03 -08:00
..
cpu Implement N-gram (#180) 2019-01-03 16:21:03 -08:00
contrib_kernels.cc Implement N-gram (#180) 2019-01-03 16:21:03 -08:00
contrib_kernels.h Kezhan/separate op def from kernels (#143) 2018-12-11 11:57:27 -08:00