nip.utils.apps_metric

nip.utils.apps_metric#

Functions

call_method(method, inputs)

check_correctness(problem, solution[, ...])

Check correctness of code solution with a global timeout.

custom_compare_(output, ground_truth)

handler(signum, frame)

reliability_guard([maximum_memory_bytes])

This disables various destructive functions and prevents the generated code from interfering with the test (e.g. fork bomb, killing other processes, removing filesystem files, etc.) WARNING This function is NOT a security sandbox.

run_test(sample[, test, debug, evaluate, ...])

if test(generated_code) is not None it'll try to run the code.

wrapper(result, problem, solution, evaluate, ...)

Classes

CODE_TYPE(value[, names, module, qualname, ...])

Capturing([iterable])

Exceptions