Hi @richa.patel,
Not sure if this is what you are looking for, but you can check when the last data reload was in an analysis by clicking on the three lines like in the image below.
This gives you an idea if a specific analysis is using incremental data loads.
Kind Regards,
Sverre
Hi @richa.patel,
Not sure if this is what you are looking for, but you can check when the last data reload was in an analysis by clicking on the three lines like in the image below.
This gives you an idea if a specific analysis is using incremental data loads.
Kind Regards,
Sverre
Hi @sverre.klein11 , Thanks for the response but this is not what I was looking though. The last data load will anyway going to change once the associated data model will be loaded again, so how will it help us to know that whether it has incremental data or not.
Hi @sverre.klein11 , Thanks for the response but this is not what I was looking though. The last data load will anyway going to change once the associated data model will be loaded again, so how will it help us to know that whether it has incremental data or not.
Hi @richa.patel,
Ah clear. I misunderstood.
In that case, you can look which data model is linked to an analysis. You can then figure out whether the data model loads are indeed a full load or incremental load.
Look for the data model linked to an analysis
Go to the data pool where the data model resides, and go to "execution history."
Then go to the "Data Job Logs". Select the Extraction Data Job and then select "General Task Log on the right. Here you can find in the bottom (most likely) if the data job execution is DELTA or FULL. If it is DELTA, it is an incremental load.
Not sure if this is the most efficient way to check an analysis has an incremental data, but it is an option nontheless 😅.
Kind regards,
Sverre Klein
Hi Richa,
to identify which data models are performing partial loads you can make use of the "Monitoring Data Pool". This data pool can be installed via Marketplace and can be used for deep analysis / monitoring of your Data Pipelines, Loads etc: Custom Monitoring (celonis.com)
e.g when you have installed the Monitoring DataPool you can also write queries based on tables like:
SELECT * FROM data_model_load_events
WHERE LOAD_TYPE = 'PARTIAL'
Sure you are than still missing the link between those identified Data Models and all analyses that are using those Data Models. This can be achieved using Pycelonis:
Pulling Data from an Analysis - PyCelonis
from pycelonis import get_celonis
celonis = get_celonis()
space = celonis.apps.get_spaces().find('Space_Name_Here')
package = space.get_packages().find('Package_Name_Here')
analysis = package.get_analyses().find('Analysis_Name_Here')
content = package.get_analysis(analysis.id).get_content()
data_model_id = content.data_model_id
BR
Dennis
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.