Can I get to know more about "Custom Data Pipeline Monitoring"?

Hi Aditya,

You should be able to download pre-built Analyses for Data Pipeline Monitoring, directly from the EMS Store.

Maybe you already went through this link, but just in case the Full documentation is here (just login to your team through this link).

Below is a high-level summary of the feature if it helps too:

Best,

Hello Stephane,

Thank you for you answer, however the link which you have provided is not accessible to me via my training account.

I have a couple of points more to discuss related to the same topic:

1. In 'Monitoring Pool' for 'data pipeline monitoring', one of the global transformations, we are not able to execute 'Data Model Executions' job as 'data_model_load_events' doesn't exist in the schema.
2. Process Data Model load for 'Data Pipeline Monitoring' is failing because of issue below:

Is there a way to resolve these issues?

Best Regards,

Aditya

Hello Stephane,

I was able to open the link now. It is the same link which I went through. Could you please guide me a little more on the queries above? Thanking in advance.

Best Regards,

Aditya

Hello Adi,

Probably Training environment won't have all the required features. Go to a sandbox or uat instance to test it.

1. Within the environment click on EMS Store (Top Right).
2. Search for the App Data Pipeline & Consumption Monitor (see image)
3. Once installed, the package will contain the analysis in Studio and the DM in Event Collection
4. Make sure that under Event Collection , Custom Monitoring is enabled (see image)

1. In Studio, you might need to reassign the Data Models manually (click on the Analysis->click on the config wheel->variables and assign DM). If the DM is not displaying, double-check step 4

Obs.:The tables are created with the first events captured after enabling the Custom Data Pipeline Monitoring. No past events are captured. The table data_consumption_updated_events is created with the first APC calculation for the team, which can take up to several days. Until then the Data Job 'Data Consumption Monitoring' will fail. The table replication_execution_finished_events is created with your the first Replication Cockpit Execution. If the Replication Cockpit is not set up, the Data Job 'Replication Cockpit Monitoring" will fail.

Best,

Gabriel