nip.code_validation

nip.code_validation#

All components for the code validation task.

Has classes for:

  • Handling data

  • Defining the RL environment

  • Generating a dataset

  • Building agents

Modules

agents

Code validation agent components.

data

Dataset class for the code validation experiments.

dataset_generation

Module for generating datasets used in code validation systems.

environment

The RL environment for code validation.

protocols

Implementations of the parts of interaction protocols specific to code validation.

rollout_analysis

Use a language model to do analysis on rollouts.