Commits · main · candle / Megatron-LM · GitLab

Apr 01, 2022
- Merge branch 'NVIDIA:main' into main · 1064dc48
  irlyngaas authored Apr 01, 2022
  
  1064dc48
- Merge remote-tracking branch 'origin/F1STAT' into main · c31a066f
  Isaac authored Apr 01, 2022
  
  c31a066f
- Adding leftover finetune and crusher changes to master before merging from NVIDIA repo · f0d181e3
  Isaac authored Apr 01, 2022
  
  f0d181e3
Feb 17, 2022
- Working crusher build with ROCm/4.5.0 · 74c83693
  Isaac authored Feb 17, 2022
  
  74c83693
Feb 16, 2022
- Removing deepspeed ops. Using ROCmSoftwarePlatform apex build for those functionalities on AMD · 9415e318
  Isaac authored Feb 16, 2022
  
  9415e318
Feb 15, 2022
- Adding changes for integrating deepspeed. Not working as of now. Use master or... · ef777805
  Isaac authored Feb 14, 2022
  ef777805
Feb 11, 2022
- Merge remote-tracking branch 'origin/F1STAT' into main · 7eb70084
  Isaac authored Feb 11, 2022
  
  7eb70084
Feb 10, 2022
- Removing evaluation at end of training, because valid_dataloader not built · 0aa86dc1
  Isaac authored Feb 10, 2022
  
  0aa86dc1
Feb 08, 2022
- Removing evaluation step from pretraining loop · 5e9b90b5
  Isaac authored Feb 08, 2022
  
  5e9b90b5
Jan 29, 2022
- Merge branch 'github-pr' into 'main' · e156d2fe
  Jared Casper authored Jan 28, 2022
  e156d2fe
- Revert incorrect fix. · cd499559
  Jared Casper authored Jan 28, 2022
  
  cd499559
Jan 28, 2022
- Merge branch 'patch-1' of https://github.com/vycezhong/Megatron-LM into github-pr · 2a34e0ec
  Jared Casper authored Jan 28, 2022
  
  2a34e0ec
- Merge branch 'main' of https://github.com/satpalsr/Megatron-LM into github-pr · 34f55429
  Jared Casper authored Jan 28, 2022
  
  34f55429
- Merge branch 'patch-1' of https://github.com/jamesr66a/Megatron-LM into github-pr · adebe364
  Jared Casper authored Jan 28, 2022
  
  adebe364
- Merge branch 'patch-2' of https://github.com/kvtoraman/Megatron-LM into github-pr · 20f6169f
  Jared Casper authored Jan 28, 2022
  
  20f6169f
- Merge branch 'patch-1' of https://github.com/rajeshkppt/Megatron-LM into github-pr · 0747e8e5
  Jared Casper authored Jan 28, 2022
  
  0747e8e5
- Merge branch 'fix' of https://github.com/singleheart/Megatron-LM into github-pr · 9882fb3f
  Jared Casper authored Jan 28, 2022
  
  9882fb3f
- Merge branch 'patch-1' of https://github.com/stas00/Megatron-LM into github-pr · 4a62d582
  Jared Casper authored Jan 28, 2022
  
  4a62d582
Jan 27, 2022
- Merge branch 'lmcafee/distrib-chkpt-fix-v2' into 'main' · fd5469aa
  Jared Casper authored Jan 26, 2022
  fd5469aa
- add clarification about the model parallel size column · 2d767f48
  Stas Bekman authored Jan 26, 2022
  
  2d767f48
- [README] specify explicitly which gpu and node size was used · 145d2eb9
  Stas Bekman authored Jan 26, 2022
  145d2eb9
Jan 26, 2022
- further clarified viewless tensor comment in transformer.py · d16e2a24
  Lawrence McAfee authored Jan 26, 2022
  
  d16e2a24
Jan 25, 2022
- Merge branch 'lmcafee/t5-free-pipe-output-true-fix' into 'main' · fc5d4c2b
  Jared Casper authored Jan 25, 2022
  fc5d4c2b
- limit 'make_viewless_tensor()' to case of micro_batch_size == 1; added comment · 24369dd6
  Lawrence McAfee authored Jan 25, 2022
  
  24369dd6
Jan 22, 2022
- fix an argument · 313730e9
  Jay authored Jan 22, 2022
  
  313730e9
Jan 21, 2022
- Latest launch scripts · 10cacfb1
  Isaac authored Jan 21, 2022
  
  10cacfb1
- Adding functionality to HOC finetuning to calculate F1 statistics · dc3daa58
  Isaac authored Jan 21, 2022
  
  dc3daa58
Jan 20, 2022
- Merge branch 'vision-merge' into 'main' · 539e39b6
  Jared Casper authored Jan 20, 2022
  539e39b6
- address review comments · 798b6a64
  Vijay Korthikanti authored Jan 20, 2022
  
  798b6a64
Jan 19, 2022
- using all_gather instead of gather (nccl does not support gather) · b037a69e
  Vijay Korthikanti authored Jan 19, 2022
  
  b037a69e
- flag for data parallel random initialization · a7ee77ea
  Vijay Korthikanti authored Jan 19, 2022
  
  a7ee77ea
- Adding Blurb HOC Finetune task · 87273694
  Isaac authored Jan 19, 2022
  
  87273694
Jan 15, 2022
- minor fix · fd8dd9c0
  Vijay Korthikanti authored Jan 14, 2022
  
  fd8dd9c0
- checkpointing rng_state of all data parallel ranks · 09d38884
  Vijay Korthikanti authored Jan 14, 2022
  
  09d38884
Jan 14, 2022
- address review comments · 343dc97a
  Vijay Korthikanti authored Jan 14, 2022
  
  343dc97a
Jan 13, 2022
- handle output_tensor == None · 7f1c5917
  Lawrence McAfee authored Jan 13, 2022
  
  7f1c5917
- more cleanup · 8fc5e323
  Lawrence McAfee authored Jan 13, 2022
  
  8fc5e323
- renamed 'free' -> 'deallocate' · c1e4526b
  Lawrence McAfee authored Jan 13, 2022
  
  c1e4526b
- removed uses are args.deallocate_pipeline_output · d10f81c5
  Lawrence McAfee authored Jan 13, 2022
  
  d10f81c5
- removed argument flag; also, converted torch.FloatTenstor -> torch.empty in previous commit · 18846a0a
  Lawrence McAfee authored Jan 13, 2022
  
  18846a0a