saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-14 20:58:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

what's in loss again

Browse source
This commit is contained in:
thomwolf 2018-11-04 11:45:44 +01:00
parent 0b7a20c651
commit 5ee171689c
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
run_squad.py
View file

@ -873,7 +873,7 @@ def main():
logger.info("HHHHH Forward")
loss, _ = model(input_ids, segment_ids, input_mask, start_positions, end_positions)
model.zero_grad()
logger.info("HHHHH Backward")
logger.info("HHHHH Backward, loss: {}".format(loss))
loss.backward()
logger.info("HHHHH Loading data")
optimizer.step()