Skip to main content
Is it possible to set delta loads from SAP in such a way, that when new column is added, the extraction won't fail, but will just add the new column to the list of the columns and treats it as unselected?

Hi Petr,

I would suggest scheduling full loads and subscribing to the delta loads. In case they fail, you will be notified by email (see picture), since we wouldn't expect frequent changes in the tables with new columnssubscribe to the data job


Hi Gabriel,

the full load is not an option for us unfortunately as we pull really big tables and the columns are added several times a year. Till now we've always added he new columns directly in SQL as it is much faster. It's just that any new column stops our export even though we do not want his new column exported, so I was hoping there is an option in Celonis o just ignore any newly added columns and do no export them by default.


Hi @petr.herzi11,

 

If you click on the extraction and select 'Extraction Settings', you have the option to include metadata changes. This will include new columns to your load. Unfortunately, this is not exactly what you asked for (they new columns will be included in the load), but at least the load will not fail.

 

Kind regards,

Jan-peter

 

delta_loads


Hi @janpeter.van.d ,

 

thanks for a hint. Indeed this might help us get the loads working with the changes, though first we will need to update our extractors as we do not have this setting currently available(running on 4.4 version).


Hi @janpeter.van.d ,

 

thanks for a hint. Indeed this might help us get the loads working with the changes, though first we will need to update our extractors as we do not have this setting currently available(running on 4.4 version).

Hi @petr.herzi11 ,

 

It might also be caused by the fact that my screenshot is taken from the general JDBC extractor, while you might use the SAP extractor. I wasn't aware that this option isn't available for you currently. If you don't see it after the update, maybe the support desk knows if it can be enabled.

 

Kind regards,

Jan-peter


Reply