Question
ArrowIOError: Arrow error: Out of memory : Error while getting data using Python API
Malloc%20size%20error1358614 68.9 KB
Hi All,
While trying to get data using Python API, I am getting below error : ArrowIOError: Arrow error: Out of memory: malloc of size 5823262912 failed.
I am using Query() method to extract data. Expected data shape is (20000,4) and using Celonis version 4.5
Please help with this error and share any related documentation.
Best regards,
Pushpendra
Hi Pushpendra,
Is it possible that there is not enough memory for this data? How much free memory does the computer have when you try to pull this data? (20000,4) should not take a lot, but maybe there are long texts in the data?
We also had problems sometimes with
pyarrow version 0.14, if there is enough free memory, it could be that installing pyarrow 0.13 solves the problem.
Does this solve your problem?
Best regards,
Simon RiezebosHi Simon,
I updated the pyarrow package to 0.15.1 and now its working fine.
Best regards,
Pushpendra
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.