nip.code_validation.data.BuggyAppsCodeValidationDataset#
- class nip.code_validation.data.BuggyAppsCodeValidationDataset(hyper_params: HyperParameters, settings: ExperimentSettings, protocol_handler: ProtocolHandler, train: bool = True)[source]#
An extension of the APPS [HBK+21] dataset with buggy solutions.
Buggy solutions were generated by asking GPT-4o to introduce bugs into the non-buggy solutions from the APPS dataset.
Methods Summary
__getitem__
(index)__init__
(hyper_params, settings, ...[, train])__len__
()__repr__
()Return repr(self).
Load the dataset.
_process_data
(raw_dataset)Process the dataset.
Attributes
dataset_filepath_name
The name of the dataset file.
instance_keys
The keys specifying the input instance.
keys
The keys (field names) in the dataset.
processed_dir
The path to the directory containing the processed data.
raw_dir
The path to the directory containing the raw data.
Methods
- __getitem__(index: Any) NestedArrayDict [source]#
- __init__(hyper_params: HyperParameters, settings: ExperimentSettings, protocol_handler: ProtocolHandler, train: bool = True)[source]#