Experiment Scripts

The following scripts are available in the scripts directory. These scripts include ones for running experiments with a grid of hyper-parameters, as well as scripts for creating datasets and various other tasks.

The Graph Isomorphism Task

ppo_gi	PPO graph isomorphism experiment using a grid of hyperparameters.
dummy_test_gi	Dummy graph isomorphism test script, for debugging purposes.
solo_agents_gi	Test solo graph isomorphism agents using a grid of hyperparameters.
create_gi_dataset	Generate a graph isomorphism dataset.

The Image Classification Task

ppo_ic	PPO image classification experiment using a grid of hyperparameters.
solo_agents_ic	Test solo image classification agents using a grid of hyperparameters.
dummy_test_ic	Dummy image classification test script, for debugging purposes.

The Code Validation Task

ei_cv	Script for running Expert Iteration (EI) with the code validation task.
create_cv_dataset	Generate a Buggy APPS dataset.

Miscellaneous Scripts

download_all_datasets	Script to download all datasets used in the project.
time_timeable	Script to time a timeable action.