From 3914eed505fb008f092b4f7980fa7b21ae1b2aff Mon Sep 17 00:00:00 2001 From: thomwolf Date: Mon, 5 Nov 2018 16:09:27 +0100 Subject: [PATCH] update readme --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 1cc7c5d2e..4ba1203f0 100644 --- a/README.md +++ b/README.md @@ -164,9 +164,9 @@ python run_classifier.py \ --output_dir /tmp/mrpc_output/ ``` -Our test runs on three seeds gave results between 83.6 and 85.6. +Our test runs on a few seeds with [the original implementation hyper-parameters](https://github.com/google-research/bert#squad) gave evaluation results between 82 and 87. -The second example fine-tunes `BERT-Base` on the SQuAD question answering task. This example runs in about 5 hours on a 4-GPU K-80. +The second example fine-tunes `BERT-Base` on the SQuAD question answering task. The data for SQuAD can be downloaded with the following links and should be saved in a `$SQUAD_DIR` directory.