cpu – R Studio Aborting with large dataset?

Currently R/igraph can only handle matrices with at most 2^31 - 1 elements, and will fail without warning with more. Future versions will be much more robust, and won’t crash. For a graph with n vertices, the distance matrix will have n*n elements. Thus the full distance matrix can’t be computed for graphs with more than n = 46340 vertices.

You can, however, compute the distance matrix piece by piece, by setting the v argument of distances to only part of the vertex set.


Note that the limitation of no more than 2^31 - 1 matrix elements comes from R’s use of 32-bit integers, even on 64-bit platforms. Also note that storing this many elements already takes up 16 GB of memory. The full distance matrix for 88336 vertices would take up 59 GB of memory, and would take a rather long time to compute.

Read more here: Source link