Ticket #303 (closed Defect: fixed)
Even with "chunks" option, Predict GLM and Predict GAM tools can still fail with RPy_RException: Error: cannot allocate vector of size 92.6 Mb
|Reported by:||jjr8||Owned by:||jjr8|
|Component:||Tools - Statistics||Version:|
The problem is that the existing "chunking" code only comes into play for the calls to the R predict function. We are not reading the rasters in chunks. Instead we read all of the rasters into memory, then chunk through the predictions. We did not consider the fact that the rasters themselves could be so large that they would not fit into memory. But this is definitely a legitimate case, particularly when you're working with many predictors, and it can still cause the error.
The solution is to modify the chunking code so it includes reading the rasters, as well doing the predictions.
Thanks to Pat Iampietro for reporting this problem.