mirrors/mindcraft
1
0
Fork 0
mirror of https://github.com/kolbytn/mindcraft.git synced 2025-07-25 01:15:24 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add some documentation

Browse source
This commit is contained in:
hlillemark 2025-03-22 16:09:59 -07:00
parent 1cefe44a15
commit d6094eecd6
1 changed files with 10 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
multi_data_collection_script.py
View file

@ -15,6 +15,16 @@ import glob
This script is intended to run the evaluation script multiple times and then automatically aggregate the This script is intended to run the evaluation script multiple times and then automatically aggregate the
successful logs into a subfolder for each run, based on the success marked in the experiment folder. Then successful logs into a subfolder for each run, based on the success marked in the experiment folder. Then
at the end it will aggregate everything into a json file, ready for training. at the end it will aggregate everything into a json file, ready for training.
Example usage:
python3 ./multi_data_collection_script.py --api vllm --model meta-llama/Meta-Llama-3-8B-Instruct --num_agents 2 --num_parallel 2 \
--tasks "tasks/crafting_tasks/test_tasks/tasks_2_agents.json:3" "tasks/crafting_tasks/test_tasks/tasks_3_agents.json:3"
Meaning run those two tasks each 2 times, with num agents. The results will be in
./full_run_logs_{date}
and ./successful_run_logs_{date}
Use the successful run logs to train the next model.
""" """