forked from XetHub/RedPajama-Data-1T
Assembled from URLs hosted at https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T
Intended to be used with curl commands like: ``` curl --parallel --parallel-immediate --parallel-max 3 --config urls.txt ``` See https://stackoverflow.com/a/66998627main
parent
78b843ef9e
commit
9db50c99a4
1 changed files (0 B → 337 KiB)
Loading…
Reference in new issue