Cluster stops behaving properly after rerunning the same function on it for a number of times – General

Hi all,

I am running into a strange problem. So I create a cluster called dl, and use parLapply to calculate a list and re combine it into a vector.

This is the output. You can see that after 4 iterations, it did not manage to apply parLapply, because something went wrong on one of the cores. The other inputs into the functions are the four nu’s, and the function can be calculated with the last set of 4 nu’s. So the problem is not that the inputs after 4 iterations became such that the function can’t be calculated anymore.

It does this at completely random number of iterations. At some point, it is just not able to calculate it anymore because the cluster stops behaving the way it should be. I am at a loss of ideas of why it is happening. Any ideas on how to debug this?

Thanks