Skip to main content
How to find if any specific analysis is using incremental data?

Hi @richa.patel,

 

Not sure if this is what you are looking for, but you can check when the last data reload was in an analysis by clicking on the three lines like in the image below.

 

image 

This gives you an idea if a specific analysis is using incremental data loads.

 

Kind Regards,

Sverre


Hi @richa.patel,

 

Not sure if this is what you are looking for, but you can check when the last data reload was in an analysis by clicking on the three lines like in the image below.

 

image 

This gives you an idea if a specific analysis is using incremental data loads.

 

Kind Regards,

Sverre

Hi @sverre.klein11 , Thanks for the response but this is not what I was looking though. The last data load will anyway going to change once the associated data model will be loaded again, so how will it help us to know that whether it has incremental data or not.


Hi @sverre.klein11 , Thanks for the response but this is not what I was looking though. The last data load will anyway going to change once the associated data model will be loaded again, so how will it help us to know that whether it has incremental data or not.

Hi @richa.patel,

 

Ah clear. I misunderstood.

 

In that case, you can look which data model is linked to an analysis. You can then figure out whether the data model loads are indeed a full load or incremental load.

 

Look for the data model linked to an analysis

image 

Go to the data pool where the data model resides, and go to "execution history."

image 

Then go to the "Data Job Logs". Select the Extraction Data Job and then select "General Task Log on the right. Here you can find in the bottom (most likely) if the data job execution is DELTA or FULL. If it is DELTA, it is an incremental load.

 

image 

Not sure if this is the most efficient way to check an analysis has an incremental data, but it is an option nontheless 😅.

 

Kind regards,

Sverre Klein


Hi Richa,

 

to identify which data models are performing partial loads you can make use of the "Monitoring Data Pool". This data pool can be installed via Marketplace and can be used for deep analysis / monitoring of your Data Pipelines, Loads etc: Custom Monitoring (celonis.com)

 

e.g when you have installed the Monitoring DataPool you can also write queries based on tables like:

 

SELECT * FROM data_model_load_events

WHERE LOAD_TYPE = 'PARTIAL'

 

Sure you are than still missing the link between those identified Data Models and all analyses that are using those Data Models. This can be achieved using Pycelonis:

 

Pulling Data from an Analysis - PyCelonis

 

from pycelonis import get_celonis

celonis = get_celonis()

 

space = celonis.apps.get_spaces().find('Space_Name_Here')

package = space.get_packages().find('Package_Name_Here')

analysis = package.get_analyses().find('Analysis_Name_Here')

content = package.get_analysis(analysis.id).get_content()

data_model_id = content.data_model_id

 

BR

Dennis


Reply