A database and collection of LLM results across models and questions.
README.md
LLM Evolution Tracking
To run, simply set up a new python environment using
python -m venv .venv/
. .venv/bin/activate
pip install -r requirements.txt
Then run
./runner.py
The models used may be changed in llm_evolution/models.py
.
This will generate a json output file containing all the responses.
To process the new results, run
./dump_output.py <output_json>
Run ./dump_output.py --help
to see other options.
File List | Total items: 12 | ||
---|---|---|---|
Name | Last Commit | Size | Last Modified |
.xet | |||
cache | |||
data/mmlu | |||
llm_evolution | |||
output_data | |||
.gitattributes | |||
.gitignore | |||
LICENSE | |||
README.md | |||
dump_output.py | |||
requirements.txt | |||
runner.py |
About
A database and collection of LLM results across models and questions.
Repository Size
Loading repo size...