Data Ingestion & Infrastructure

Hi Community,I’m working on cleaning up our data pools in OCPM, which currently include:Migrated CPM → OCPM pools New OCPM pools Pools that extract data directly from source systems Pools that combine multiple source extractions Derived data pools (with filters, perspectives, etc.)What is a good way to organize or separate these different types of data pools? Specifically:Is there a recommended approach to distinguish source-based pools from combined or derived pools? Are there best practices for naming conventions to make it easier to manage and identify them? How can I easily see which data pools are connected to which assets (apps, views, packages)?Any guidance or examples would be greatly appreciated!Thanks in advance,ShalinI am aware of this question, but it was posted a while ago and does not provide the granularity I am looking for🙁https://community.celonis.com/topic/show?tid=4263&fid=2 

Hi all,I have a question relating to “hygiene” in data pools.In my organisation we use manual data ingestion and upload files into our data pools. Over time, a large number of files and tables was added and created. I’d like to do a bit of house-keeping and remove obsolete/ unused files. How can I do that? I have analyst access.I look forward to hearing from you. Thanks.Kind regards,Vladimir

Dear community, I would like to set up a data pool parameter to allow me to switch between test and prod environment? So I would need two global variables for my data jobs:var_data_source: to allow me switch between test schema and prod schema var_table_name: to allow me when creating table to add _test at the end of the table nameI have only found the way to create parameters in EACH data job under transformation and refer to the data pool parameter. Is there a smarter way? I am still using the data integration (not OCPM). Thanks a lot!   

Hi There,We’d like to integrate our Celonis (SaaS) solution to one of our other cloud applications (ServiceNOW) using the other application’s REST API. We need to deploy a VPN for this integration to ensure secure communication. Does Celonis SaaS (or the underlying platform Azure/Amazon) provide a means for deploying a VPN? e.g. Azure VPN Gateway or AWS Transit Gateway Kind Regards, Seamus

Has anyone experience on connecting Celonis with SAP Business One (BOne)?How easy is the connection? 

Hello all, I’m currently working on combining various cycle times (e.g. from PO Item creation to Goods Receipt, or from Goods Receipt to Invoice Receipt) with key figures from my Case Table in a single OLAP table.To achieve this, I’ve tested two different approaches:Cycle Time Calculation Based on the Activity Table: This method allows me to control which occurrence to consider — for example, in cases of multiple GRNs for the same PO line, I can choose to include only the first one. The formula delivers the expected results. However, I’m unable to combine this approach with other key figures from my Case Table (e.g. Company Code, PO Item Count, etc.) in the same OLAP table. Additionally, if the cycle time is negative (e.g. GRN before PO Item creation), the formula returns “–” instead of the actual negative value.   AVG(CALC_THROUGHPUT ( FIRST_OCCURRENCE [ 'Create Purchase Order Item'] TO FIRST_OCCURRENCE [ 'Record Goods Receipt' ] , REMAP_TIMESTAMPS ("_CEL_EKPO_ACTIVITIES"."EVENTTIME"

Good day, I have an OCPM data model with 2 objects, a case and a user. I need to select my case eventlog as the default eventlog. How do I do that? I know I can create an eventlog in Perspectives and make it the default eventlog but I dont want to create an additional eventlog , I want to select the existing case eventlog as the default eventlog. Thank you

Hello everyone, I’m trying to use Action Flow to trigger chained data jobs, meaning job A is executed, once it’s done job B is executed, once it’s done job C is executed. Ideally, I would like to launch Data Model Schedule from Action Flow, but I’m only able to launch data jobs and load data model. What I’ve done so far is: 1. Creating json file with all my jobs ID (A,B,C) - Parse Json Module2. Creating a POST request using API Celonis Key, to access data pool and launch jobs, load data model -    HTTP Make a request Module3. Using Iterator module to repeat step 2 for all job IDThe issue I’m facing is, job A need to be completed before launching job B and same for job B and C (this is what I’m calling chained data jobs). Configuring a Sleep in the iterator loop greater than the running time of my jobs is working, but not optimized. My question is: Do you know if there is a way to trigger chained data jobs in Action Flow, meaning triggering Data Model Schedule or launching several jobs

Hey all,I have a process where I have four activities labeled: A, B, C, D.In the event log I have for one case equal timestamps for B and C: 08:11:00 until 08:23:00.My problem is that Celonis visualizes this process as A → B → C → D, however I expect the process to look like A → B, C → D. Is there any way to do this, and if so, how?

Does anyone have the steps to do the data integration with the Dynamics 365 for order to cash process?

Dear Celonis users, I only know how to create a filter in KM and apply it to a table.  I would like to restrict the scope of filters, so that they will only have impact on one tab, when I put those filters in the filter bar. Is it possible to achieve this goal on Celonis web version?

Hello Celonis users, Good day. There is no chance for me to change anything in the data model and I mainly work in PQL Editor. My goal is to use fields from N-side tables to filter data and visualize it. More details:Data model: Table A [N] → [1] Table B [1] ← [N] Table C Table A:Material code            Warehouse            Procurement type1                                  Australia                    External1                                     USA                        Own produced2                                      UK                          Own produced2                                      USA                         Others3                                   Austrialia                   External3                                       UK                          Own produced Table BMaterial code              Responsible1                                        Martin2                                         Mary3                                         Julia Table CMaterial

Hey everyone! Has anyone tried using the Microsoft Entra authentication to create a connection between Microsoft SQL and Celonis? (https://docs.celonis.com/en/connecting-to-microsoft-sql.html#UUID-9e582e53-55d8-d3e9-7b6c-1e122f4219d9_section-idm4544307539120034248385337057)We are trying to enable this and Celonis Help source documentation we stumbled upon provides how an Entra authentication works (https://learn.microsoft.com/en-us/sql/connect/jdbc/connecting-using-azure-active-directory-authentication?view=sql-server-ver16) but we miss the steps on how do we set it up in Celonis directly. Any insights on the actual setup would be very much appreciated. TIA! Good day! 

Hi everyone,in our Procurement analysis we are evaluating price developments and also compare them with external reference data provided by the German Federal Statistical Office (Destatis). The data is available as CSV flat files, which we currently download and manually integrate into our data model.I was wondering:👉 Has anyone already built an automated data ingestion pipeline for this kind of use case (regularly pulling official statistics or external CSV-based sources into Celonis)?👉 If yes, what approach or tools did you use (APIs, connectors, scheduled pipelines, etc.)?Any insights or best practices would be highly appreciated!Thanks in advance 🙌

Hey, I’ve an table I hope that is being creating initially using excel import. Now that I want to update the data in the same table. Can anyone please guide me to do that. Thanks in advance RegardsChethan

Hi everyone,I’m trying to connect MongoDB to Celonis. At first, I assumed that I’d need to use a custom JDBC driver (based on a thread that I’ve read here and the Celonis documentation).However, when I reached the step to select the “Database Type” in the connector, I couldn’t find a fitting option for MongoDB.Has anyone successfully set this up?Should I use a specific Database Type in this case? Or is there another workaround to get MongoDB connected?Thanks for any tips or guidance! 

Hi, we’re planning to use task mining for one of our customers.Would it be possible to install a desktop application on employees’ laptops without them noticing?Also, once the application has been installed, can it be run silently so that employees are not aware that they are being monitored?

Hi everyone, some months ago, I faced a challenge related to getting variables from a view using PyCelonis. Today I have another challenge where I need to get the result from multiple KPIs and send it back to the data pool.At the beginning, I used the module “Get Rows” from action flows, and I was able to get the values from each KPI. However, in some KPIs, the values that I’m getting inside actions flows, are completely different from the ones that exist in an OLAP’s table where those KPIs are being used. I don’t understand the reason for this, so I was thinking of a workaround solution with PyCelonis, where I would get the values from each KPI and create a dataframe that can be sent to the datapool.I can see in the documentation that we can get the values from records, but only of those records that exist in a data model. But I cannot see in the documentation how to deal with KPIs.Does anyone know if is there a way to get the value of multiple KPIs with PyCelonis, pls?

Hello everyone,I want to restrict access to a specific column in a data model so that non-admins cannot see the values in that column or the column itself. Is there a way to achieve this using data permissions? Thank you!Best,Emilia

Hi all,I would like to export datapools as json using content-cli in the ML workbench in order to backup them in Git. I have created an API key in my profile and used it in a python script with content-cli pull data-pool --id data-pool-id, which successfully generated a json of the datapool.However, I don't want to do this with a user-based API key but with an Application key (created under admin&settings).When I run the same command using the Application key, I get the error "error: The provided team or api key is wrong."With get_celonis(api_token=“applicationkey”, key_type="APP_KEY") however, I can see the Application key and all its permissions.Is content-cli possible with an Application key and if so, how can I use it?

Hello Community,I need you help in using the PQL Function QUANTITY_CONVERTMy objective is simple: I want to convert the SAP Field LIPS.BTGEW to Tons (TO). The original Unit is stored in field LIPS.GEWEI.With this try I get an errorQUANTITY_CONVERT("LIPS"."BRGEW", FROM ("LIPS"."GEWEI"), TO ('TO'))A PQL error is preventing this query from executing.Syntax error near [)] after reading [QUANTITY_CONVERT("LIPS"."BRGEW", FROM ("LIPS"."GEWEI"), TO ('TO')] at line 32. Please refer to PQL documentation for available syntax. What's the problem? If I understand the docu (https://docs.celonis.com/en/quantity_convert.html) correctly, I must not provide a conversation rates table?This operator converts quantity units based on a QUANTITY_CONVERSION_RATES table, which is optionally provided by the user. If not provided by the user, a default QUANTITY_CONVERSION_RATES table will be used. Where can I see the contents of the default QUANTITY_CONVERSION_RATES table?Thanks for helpBest, Thomas 

I need to use a filter in my extraction, but the field in the table I'm bringing it from has a separate name "Date Archived" Example.When I use it like this "Date Archived" >= '2024-01-01 00:00:00', it doesn't load, I believe it's because of the space between the column name. Does anyone know how to solve this?I've tried to put the column as a parameter, but I still can't. 

How do I see the replication cockpit also along with the data job. How do i set the change table and trigger for it?

Hi team,I need help in understanding how to apply filter for KONP table in data extraction joining another table.My requirement is:1.For A018 table - I need all the records where A018.MATNR =  EKPO.MATNR.2.For KONP table, all the records from KONP table where A018.KSCHL = KONP.KSCHL If i am trying to implement 1st point in filter condition of A018 extraction as screenshot below,Data extraction fails with error : Error loading resource A017. The multi-part identifier "ts1.EKPO.MATNR" could not be bound.Can you please help in this? Thank you in advance.

Within an OLAP table, I would like to use both the Delivery Line Item Date ("VBEP"."EDATU") and the shipment gross weight ("LIPS"."BRGEW") Does anyone know how I can apply a PQL function to combine these tables? Please find the error below. I looked into the PQL documentation but I can't find the solution. Error in formulaNo common table could be found. The tables ["VBEP"] and ["LIPS"] are connected, but have no common table. This means that they do not have a direct (or indirect) 1:N or N:1 relationship. Join path: [VBEP]N <-- 1![VBAP]!1 --> N[VBFA]N <-- 1[LIPS]. For more information on the join path, search for "Join functionality" in PQL documentation.