Commit 20f6169f authored by Jared Casper's avatar Jared Casper
Browse files

Merge branch 'patch-2' of https://github.com/kvtoraman/Megatron-LM into github-pr

parents 0747e8e5 0fddb8b7

README.md

+0 −1
Original line number Diff line number Diff line
@@ -31,7 +31,6 @@ All the cases from 1 billion to 1 trillion parameters achieve more than 43% half 
      * [Data Preprocessing](#data-preprocessing)

      * [BERT Pretraining](#bert-pretraining)

      * [GPT Pretraining](#gpt-pretraining)

      * [GPT Pretraining](#gpt-pretraining)

      * [T5 Pretraining](#t5-pretraining)

      * [Distributed Pretraining](#distributed-pretraining)

      * [GPT-3 Example](#gpt-3-example)