Request is to delete data from 2018-2020 and we were exploring of a better way than creating and scheduling scripts to delete the data, which seems manual. If there is a better way to automate the process for future as well, that will be really great!
Question
Is there an automated mechanism to delete past historical data from Celonis?
AFAIK, you have in the PROCESS MODEL the data that were in the ETL part (Vertica, where you do the transformations) when you do the Process Model Load.
So, if I am correct, you just need to delete data from 2018-2020 from the tables in the extraction/transformations, then do a full load of the Process Model
Anyway, regarding APC metrics, it counts the data in the extraction/transformation tables, not the data that you have in the Process Model.
Dear Arunjit Das,
Guillermo Gost is correct.
We included a parameter in our common data pool that acts as a dynamic date filter (Logic: today minus 18 months) into our extractions and into our delete statements that we have scheduled and that helps us keep track of the amount of data we pull and have within Celonis.
Since it is part of the scheduled process its basically automated and works for us quite well as a workaround :)
Kind regards,
Lisa
Hello Both,
Thank you for the answers!!
May be I should have told this in my original post but we did not want to do full load as the data size is huge (5 years) and last time it took around 2-3 weeks to complete a load of 2 years. This time we wanted to keep 3 years of previous data and pull only one year of data which took almost 4 days due to the data size.
Hence we went with manual deletion of the older data which was surprisingly quick and deleted data worth of 2 years in hours. Note- we deleted in batches, may be that could have saved us some time there.
Regards - Arunjit
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.