nip.code_validation.dataset_generation._generate_buggy_solutions#
- nip.code_validation.dataset_generation._generate_buggy_solutions(results: ListProxy, datum: list[str, Any], model: str, system_prompt: str, max_modifications: int, max_attempts: int | None = None) ListProxy [source]#
Generate buggy solutions for a given datum and append them to the result list.
If an exception is raised during the process, a list containing None is appended to the result list.
- Parameters:
results (ListProxy[list[str | None]]) – A list proxy to store the buggy solutions.
datum (list[str, Any]) – The corresponding datum from the original APPS dataset.
model (str) – The model to use for generating buggy solutions.
system_prompt (str) – The system prompt to provide context to the model.
max_modifications (int) – The maximum number of solutions to modify.
max_attempts (int, optional) – The maximum number of attempts to generate a valid buggy solution, default is None.
- Returns:
results (ListProxy[list[str | None]]) – The list proxy with the buggy solutions appended.