Cannot evaluate code inferenced with LLama3.1 Instruct 8B

[wyettzeng]

I am doing best of 64 evaluations with LLama 3.1 Instruct 8B. However, whenever I try to evaluate the inference output the program always output "Terminated" after about 1/4th of the way (without me doing anything). Here is my inferences:

https://drive.google.com/file/d/1A9aOw-xy3p0bF5oJF7Eh_JgFEKGIAiwS/view?usp=sharing

[terryyz]

I think this happens due to resource exhaustion, as we use concurrent execution. Some output executions may require a lot of resources and result in unexpected termination. By default, we use all the CPUs on the machine. You may find a better machine for execution or limit the number of works (via parallel).

[wyettzeng]

got it, let me try again