saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-30 20:18:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Log warning when GetGradientForOp() silently fails. (#6586)

Browse source 
* Add warning when GetGradientForOp() silently fails.

In some cases, `GetGradientForOp()` can return without creating any nodes, which may lead to an invalid graph being created.
This commit is contained in:
Derek Murray 2021-02-10 10:01:16 -08:00 committed by GitHub
parent b09bfc8611
commit 88d48063fa
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 5 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
orttraining/orttraining/core/framework/gradient_graph_builder.cc
View file

@ -211,7 +211,11 @@ Status GradientGraphBuilder::Build(const std::unordered_set<std::string>* p_init
}
GradientDef node_defs = GetGradientForOp(gradient_graph_config_, graph_, node, output_args_need_grad, input_args_need_grad, logger_);
if (node_defs.empty()) {
LOGS(logger_, WARNING) << "GetGradientForOp() did not create any nodes for node "
<< node->Name() << " of type " << node->OpType() << ".";
}
// updates arg name if gradient accumulation is needed
for (auto& op_def : node_defs) {
for (auto& arg : op_def.output_args) {