Hi all,
I currently have the following challenge. My source table unfortunately does not have a timestamp, but has a column with the date and a column with the time. Now I would like to retrieve in my Delta Filter Statement the data that has been added or that has changed in the last 15 minutes. How can I write this in the delta filter statement?
Thank you and best regards
Sarina
Hello @sarina.somme , any chance to have custom view on top the source table at source system with timestamp data type?
I havent try but I belief the delta filter has limited filter operators, it is not full SQL https://docs.celonis.com/en/extractions-452165.html#UUID-a8c152e2-5bda-9a10-8bb0-d9e5f20a175e_id_Extractions-Tableconfiguration
Thank you for your reply. It also seems to me that I either reload the entire day every 15 minutes with the Date field using the offset or we need to add a timestamp to the source.
have a delta variable calculated in the global job from this table to get latest date and time and sutract date or time based on you need and use that variable in the delta filter
date >= latest date
and time >= latest time - 15 mins
I think that this will not work with respect to the time. Because the time is stored as an integer in the source and the value is reset every day. So the maximum value for a day is 86,400, which means that my FIND_MAX() function has the value 86,400 and cannot load lower time values for the next day. Or am I missing something?
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
