Skip to main content
Question

ArrowIOError: Arrow error: Out of memory : Error while getting data using Python API

  • November 11, 2019
  • 2 replies
  • 37 views
P
Level 2
Malloc%20size%20error1358614 68.9 KB Hi All, While trying to get data using Python API, I am getting below error : ArrowIOError: Arrow error: Out of memory: malloc of size 5823262912 failed. I am using Query() method to extract data. Expected data shape is (20000,4) and using Celonis version 4.5 Please help with this error and share any related documentation. Best regards, Pushpendra

2 replies

S
Level 0
  • simon.rieze
  • Level 0
  • November 15, 2019
Hi Pushpendra, Is it possible that there is not enough memory for this data? How much free memory does the computer have when you try to pull this data? (20000,4) should not take a lot, but maybe there are long texts in the data? We also had problems sometimes with pyarrow version 0.14, if there is enough free memory, it could be that installing pyarrow 0.13 solves the problem. Does this solve your problem? Best regards, Simon Riezebos
P
Level 2
Hi Simon, I updated the pyarrow package to 0.15.1 and now its working fine. Best regards, Pushpendra
Community Code of ConductAccessibility statement