Add curl config

XingyanLiu

Assembled from URLs hosted at https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T

Intended to be used with curl commands like:

```
curl --parallel --parallel-immediate --parallel-max 3 --config urls.txt
```

See https://stackoverflow.com/a/66998627

main

Zach Nation

parent 78b843ef9e

commit 9db50c99a4

1 changed files (0 B → 337 KiB)

Split Unified