Commit 569b3dab authored by Mohammad Shoeybi's avatar Mohammad Shoeybi
Browse files

Merge branch 'l2_grad_clip_fix_script' into 'master'

updated the script

See merge request ADLR/megatron-lm!79
parents f46d1c32 25234f8a
Loading
Loading
Loading
Loading
+1 −1
Original line number Diff line number Diff line
@@ -20,7 +20,7 @@ python -m torch.distributed.launch $DISTRIBUTED_ARGS ./tasks/main.py \
               --task $TASK \
               --valid-data $VALID_DATA \
               --tokenizer-type GPT2BPETokenizer \
               --strict-lambada
               --strict-lambada \
               --vocab-file $VOCAB_FILE \
               --merge-file $MERGE_FILE \
               --load $CHECKPOINT \