Loading megatron/data/test/test_indexed_dataset.py +4 −0 Original line number Diff line number Diff line # This file isn't really a formal automated test, it's just a place to # put some code used during development and manual testing of # indexed_dataset. import argparse import os import sys Loading Loading
megatron/data/test/test_indexed_dataset.py +4 −0 Original line number Diff line number Diff line # This file isn't really a formal automated test, it's just a place to # put some code used during development and manual testing of # indexed_dataset. import argparse import os import sys Loading