Data Monitoring / Data Completeness Check: SAP Tables import in Celonis Cloud

Dear all,
for whatever reason, we had the issue that there were data events missing in celonis.
In detail: In the table BSEG some rows were missing and therefore we did not had the Activity ‘Clear Invoice’ for some cases.

We have the CELONIS IBC and delta load functionality to fetch the SAP tables.

Hence, we want to introduce a Data Monitoring / Data Completeness Check.
For instance, on a monthly basis we compare the BSEG in SAP with BSEG in Celonis based on number of rows, primary keys, table content…

Question:
Has somebody already implemented some Data Governance in Celonis and how to do it?

I am sure all of you get a lot of questions from the business users about data quality, data consistency, data completeness … our goal is to have some setup to track and monitor these topics

thanks & br,
Stefan

Hi Stefan, I am needing to do that same kind of data completeness (sync to be more exact) validation. Did you manage to come up with any solution?
So far I was planning on once a month do a full load of only the key fields (should be a bit quicker and rename the extracted BSEG table with another name, for example BSEG_CHECK) and then in IBC comparing the data between BSEG table (populated with delta extractions) and the BSEG_CHECK (populated with a full load) to see if number of records match). I don’t know how usefull this will be, because I think that in most cases the issue is not missing records, but records which are not updated with the latest changes, so the count will normally match…

Regards,
Nicolas

Hi,

to be honest we have not had much progess in the topic.
For O2C and P2P we replace the BSEG table with

image

For BSAD, BSAK we load every day the last fiscal year

image

Of course this is far from optimal.

In Accounts Payable we still need the BSEG (columns from BSEG). There we also load every day the last fiscal Year. Similiar with, for instance, BKPF -> Reason exactly as you said. Records which are not updated correctly or the corresponding change date (e.g. aedat) not updated correctly.

I got in contact with celonis and they provide “Real- Time Extractor” nowadays. This extractors simply log all changes to a table (new record, update, delete) and sync these changes with the IBC. Of course, due to the logging, there is more load on the sap system thats why we did not implemented it so far.