nip.utils.apps_metric.check_correctness#

nip.utils.apps_metric.check_correctness(problem, solution, evaluate=None, timeout=30, debug=False, return_outputs=False)[source]#

Check correctness of code solution with a global timeout. The global timeout is to catch some extreme/rare cases not handled by the timeouts inside run_test