Suppose I have data for 3 months and using some connection I have imported the data in the Celonis for that 3 months and created Data Model. Again I got additional data for next 3 months, now I want to create another data model only for the new 3 months data. How can we use Incremental loading for these type of scenarios...?
Question
I need to load data as Delta/Incremental load.
+4
+6Can you explain your scenario in detail? Is this a onetime activity or do you expect this to happen every 3 months automatically? If yes, what is your data source?
+4Hi @sathish.kumar.s ,
Thank you for replying.
Yes, I'm expecting to happen every 3 months & data source is Oracle.
+5If your connection is already established between Oracle and Celonis you need to schedule the extraction jobs and set up a trigger for transformation job.
If you have uploaded manual file then you can try uploading data using python query or ML workbenck so that whenever the new data hits you just need to refresh the query then it should also trigger your extraction and transformation accordingly as point mentioned above.
+6Hi @sathish.kumar.s ,
Thank you for replying.
Yes, I'm expecting to happen every 3 months & data source is Oracle.
You can setup two data extraction jobs one to load the data for the first 3 months (rename these tables with a suffix 'old' in transformation) and another one to load for last 3 months (rename these tables with a suffix 'new' in transformation). Correspondingly, you can configure two different data models using these tables.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.