Skip to main content
Question

Executing Data Job duplicates data

  • January 11, 2021
  • 1 reply
  • 6 views

Hi, a fairly basic question from a new user I expect! Im currently carrying out the Implementation Professional training. When I Execute an extraction it seems to stack a new data set on top of the first. My initial response was to make the Execution a Full Load rather than a Delta Load, but when I ran this, it ran for 2.5 hours without finishing and I had to close it down. Can anyone provide advice on next steps? Thanks! Dan

1 reply

  • Level 0
  • 145 replies
  • November 9, 2021

Hi Dan,

 

when carrying out a full load, all tables in the Celonis storage are deleted and replaced with the data that will be extracted. Extractions of large tables can take a while so I suspect you are extracting a table with lots of information. For the next steps, I would suggest limiting the columns of the table to only relevant ones

image.png 

& apply filters in order to decrease the data that will be extracted.

image.png 

Afterwards you can execute a full load again. But I assure you, data will not be duplicated :).

 

BR

Kevin