nip.utils.apps_metric.run_test

Contents

nip.utils.apps_metric.run_test#

nip.utils.apps_metric.run_test(sample, test=None, debug=False, evaluate: List[str] | None = None, timeout=5)[source]#

if test(generated_code) is not None it’ll try to run the code. otherwise it’ll just return an input and output pair.