Skip to main content
Question

Is it possible to upload 2 seperate csv files for the activity table?

  • August 24, 2021
  • 7 replies
  • 19 views
florian.mrkvi
Level 7
Forum|alt.badge.img

As soon as our CSV file for the activity table exceeds the filesize of 4GB Celonis is throwing an error and I suppose this is due to the filesize.

I cannot reduce the dataset any more so I hope there might be a way to upload 2 seperate files and join them together within Celonis. Unfortunately I can't find such a function anywhere. Or maybe there is another way to bring big activity tables to Celonis without a database connection? Would that work in IBC?

 

I work On-Prem 4.6.0-RELEASE_2babc1e_20200831_0915

7 replies

A
  • Anonymous
  • August 24, 2021

Hi Florian, have tried uploading to two separate temporary tables and then an SQL Union to create the activity table?

Hope it helps

florian.mrkvi
Level 7
Forum|alt.badge.img
  • florian.mrkvi
  • Author
  • Level 7
  • August 25, 2021

Hi Florian, have tried uploading to two separate temporary tables and then an SQL Union to create the activity table?

Hope it helps

Hi and thank you for your answer! I am not sure where you used the SQL statement. I don't have direct access to HANA. I just upload a CSV file which gives me a table representation in the datamodel view. If I uploaded a 2nd CSV file I would get a second table. Where can I enter the SQL statement?

 

BR Florian

janpeter.van.d
Level 12
Forum|alt.badge.img+26

Hi Florian,

 

Do you have access to the 'Event Collection' module in Celonis? That's where SQL statements can be made. I guess this should be available also in version 4.6 on-premise, but are not sure. If you cannot see it, maybe you can ask a system administrator/data engineer if it is visible for them, and if that is the case, ask for permissions.

 

Within the IBC/EMS this is definitely possible, you could test it with a snap+ account (it is not available in snap)

.
Level 1
  • .146001128
  • Level 1
  • September 9, 2021

OnPremise CPM4 does not have Event Collection. As far as I know, CPM4 does not have a size limit for upload. When you separate the files and upload them, do you face any issue?

florian.mrkvi
Level 7
Forum|alt.badge.img
  • florian.mrkvi
  • Author
  • Level 7
  • September 20, 2021

Hi Gabriel,

 

sorry for my late response, I haven't been in the office for 2 weeks.

 

To me CPM4 seems to have a size limit for singke files because I can upload a 3.9GB CSV file without a problem but a 4GB (and bigger) files give an error.

 

The big file is my activity table. f I split it I am left with 2 tables in the datamodel but I can only define 1 table as "activity table". On the other table this selection is grayed out then. You can try this out youself by splitting any activity table into 2 files.

 

Best regards,

Florian

R
Level 8
Forum|alt.badge.img+12

Hi @florian.mrkvi 

 

Yes there is file size constraint and it throws error when we exceed that limit of 4GB.

 

We need to split it in that case and then upload it.

florian.mrkvi
Level 7
Forum|alt.badge.img
  • florian.mrkvi
  • Author
  • Level 7
  • September 22, 2021

Hi @Rohit Kumar 

Thank you for confirming the file size. As I already discussed witrh your collegues earlier I am not sure if this is an option for me in CPM4. I personally have no access to HANA and the merge of the 2 files cannot be done in the Data Model View.

 

Nevertheless thank you and I think I'll wait until we switch to EMS ;)

 

Best regards,

Florian Mrkvicka

Community Code of ConductAccessibility statement