Data Ingestion & Infrastructure

Hi Community,I’m working on cleaning up our data pools in OCPM, which currently include:Migrated CPM → OCPM pools New OCPM pools Pools that extract data directly from source systems Pools that combine multiple source extractions Derived data pools (with filters, perspectives, etc.)What is a good way to organize or separate these different types of data pools? Specifically:Is there a recommended approach to distinguish source-based pools from combined or derived pools? Are there best practices for naming conventions to make it easier to manage and identify them? How can I easily see which data pools are connected to which assets (apps, views, packages)?Any guidance or examples would be greatly appreciated!Thanks in advance,ShalinI am aware of this question, but it was posted a while ago and does not provide the granularity I am looking for🙁https://community.celonis.com/topic/show?tid=4263&fid=2 

Hello,I am trying to get data from a Microsoft sharepoint list to the Celonis Platform.According to the Flowchart provided by the API-Team - When to use the Standard Data Ingestion API (and other methods) - the extractor builder should be used for a Sharepoint data transfer, since the REST API is exposed.I tried to set up the connection, but I fail when configuring the endpoint, since I get xml-data even if I specify that I would like to have a json structure (Request Parameter - Accept: application/json;odata=verbose)Does anyone have experience with connecting the MS universe with the Celonis universe?I also found a workaround that works (Push CSV to Data Integration), but I would rather orchestrate all the data loads in the Data Integration environment instead of using Process Automation modules to make a data transfer.Thanks for your support!BR THomas

Hi everyone,has anyone here worked with Coupa’s APIs — especially the requisition_revision_records and requisition_revision_record$requisition-lines APIs?Does anyone know if these are still supported by Coupa?Many thanks.

We can update augmented attributes via an Action flow, but is there a way to mass-update directly from PyCelonis?

Hi all,I have a question relating to “hygiene” in data pools.In my organisation we use manual data ingestion and upload files into our data pools. Over time, a large number of files and tables was added and created. I’d like to do a bit of house-keeping and remove obsolete/ unused files. How can I do that? I have analyst access.I look forward to hearing from you. Thanks.Kind regards,Vladimir

Dear community, I would like to set up a data pool parameter to allow me to switch between test and prod environment? So I would need two global variables for my data jobs:var_data_source: to allow me switch between test schema and prod schema var_table_name: to allow me when creating table to add _test at the end of the table nameI have only found the way to create parameters in EACH data job under transformation and refer to the data pool parameter. Is there a smarter way? I am still using the data integration (not OCPM). Thanks a lot!   

Hi There,We’d like to integrate our Celonis (SaaS) solution to one of our other cloud applications (ServiceNOW) using the other application’s REST API. We need to deploy a VPN for this integration to ensure secure communication. Does Celonis SaaS (or the underlying platform Azure/Amazon) provide a means for deploying a VPN? e.g. Azure VPN Gateway or AWS Transit Gateway Kind Regards, Seamus

Has anyone experience on connecting Celonis with SAP Business One (BOne)?How easy is the connection? 

Hello all, I’m currently working on combining various cycle times (e.g. from PO Item creation to Goods Receipt, or from Goods Receipt to Invoice Receipt) with key figures from my Case Table in a single OLAP table.To achieve this, I’ve tested two different approaches:Cycle Time Calculation Based on the Activity Table: This method allows me to control which occurrence to consider — for example, in cases of multiple GRNs for the same PO line, I can choose to include only the first one. The formula delivers the expected results. However, I’m unable to combine this approach with other key figures from my Case Table (e.g. Company Code, PO Item Count, etc.) in the same OLAP table. Additionally, if the cycle time is negative (e.g. GRN before PO Item creation), the formula returns “–” instead of the actual negative value.   AVG(CALC_THROUGHPUT ( FIRST_OCCURRENCE [ 'Create Purchase Order Item'] TO FIRST_OCCURRENCE [ 'Record Goods Receipt' ] , REMAP_TIMESTAMPS ("_CEL_EKPO_ACTIVITIES"."EVENTTIME"

Good day, I have an OCPM data model with 2 objects, a case and a user. I need to select my case eventlog as the default eventlog. How do I do that? I know I can create an eventlog in Perspectives and make it the default eventlog but I dont want to create an additional eventlog , I want to select the existing case eventlog as the default eventlog. Thank you

Hello everyone, I’m trying to use Action Flow to trigger chained data jobs, meaning job A is executed, once it’s done job B is executed, once it’s done job C is executed. Ideally, I would like to launch Data Model Schedule from Action Flow, but I’m only able to launch data jobs and load data model. What I’ve done so far is: 1. Creating json file with all my jobs ID (A,B,C) - Parse Json Module2. Creating a POST request using API Celonis Key, to access data pool and launch jobs, load data model -    HTTP Make a request Module3. Using Iterator module to repeat step 2 for all job IDThe issue I’m facing is, job A need to be completed before launching job B and same for job B and C (this is what I’m calling chained data jobs). Configuring a Sleep in the iterator loop greater than the running time of my jobs is working, but not optimized. My question is: Do you know if there is a way to trigger chained data jobs in Action Flow, meaning triggering Data Model Schedule or launching several jobs

Hey all,I have a process where I have four activities labeled: A, B, C, D.In the event log I have for one case equal timestamps for B and C: 08:11:00 until 08:23:00.My problem is that Celonis visualizes this process as A → B → C → D, however I expect the process to look like A → B, C → D. Is there any way to do this, and if so, how?

Does anyone have the steps to do the data integration with the Dynamics 365 for order to cash process?

Dear Celonis users, I only know how to create a filter in KM and apply it to a table.  I would like to restrict the scope of filters, so that they will only have impact on one tab, when I put those filters in the filter bar. Is it possible to achieve this goal on Celonis web version?

Hello Celonis users, Good day. There is no chance for me to change anything in the data model and I mainly work in PQL Editor. My goal is to use fields from N-side tables to filter data and visualize it. More details:Data model: Table A [N] → [1] Table B [1] ← [N] Table C Table A:Material code            Warehouse            Procurement type1                                  Australia                    External1                                     USA                        Own produced2                                      UK                          Own produced2                                      USA                         Others3                                   Austrialia                   External3                                       UK                          Own produced Table BMaterial code              Responsible1                                        Martin2                                         Mary3                                         Julia Table CMaterial

Hey everyone! Has anyone tried using the Microsoft Entra authentication to create a connection between Microsoft SQL and Celonis? (https://docs.celonis.com/en/connecting-to-microsoft-sql.html#UUID-9e582e53-55d8-d3e9-7b6c-1e122f4219d9_section-idm4544307539120034248385337057)We are trying to enable this and Celonis Help source documentation we stumbled upon provides how an Entra authentication works (https://learn.microsoft.com/en-us/sql/connect/jdbc/connecting-using-azure-active-directory-authentication?view=sql-server-ver16) but we miss the steps on how do we set it up in Celonis directly. Any insights on the actual setup would be very much appreciated. TIA! Good day! 

Hi everyone,in our Procurement analysis we are evaluating price developments and also compare them with external reference data provided by the German Federal Statistical Office (Destatis). The data is available as CSV flat files, which we currently download and manually integrate into our data model.I was wondering:👉 Has anyone already built an automated data ingestion pipeline for this kind of use case (regularly pulling official statistics or external CSV-based sources into Celonis)?👉 If yes, what approach or tools did you use (APIs, connectors, scheduled pipelines, etc.)?Any insights or best practices would be highly appreciated!Thanks in advance 🙌

Hey, I’ve an table I hope that is being creating initially using excel import. Now that I want to update the data in the same table. Can anyone please guide me to do that. Thanks in advance RegardsChethan

Hi everyone,I’m trying to connect MongoDB to Celonis. At first, I assumed that I’d need to use a custom JDBC driver (based on a thread that I’ve read here and the Celonis documentation).However, when I reached the step to select the “Database Type” in the connector, I couldn’t find a fitting option for MongoDB.Has anyone successfully set this up?Should I use a specific Database Type in this case? Or is there another workaround to get MongoDB connected?Thanks for any tips or guidance! 

Hi, we’re planning to use task mining for one of our customers.Would it be possible to install a desktop application on employees’ laptops without them noticing?Also, once the application has been installed, can it be run silently so that employees are not aware that they are being monitored?

Hi everyone, some months ago, I faced a challenge related to getting variables from a view using PyCelonis. Today I have another challenge where I need to get the result from multiple KPIs and send it back to the data pool.At the beginning, I used the module “Get Rows” from action flows, and I was able to get the values from each KPI. However, in some KPIs, the values that I’m getting inside actions flows, are completely different from the ones that exist in an OLAP’s table where those KPIs are being used. I don’t understand the reason for this, so I was thinking of a workaround solution with PyCelonis, where I would get the values from each KPI and create a dataframe that can be sent to the datapool.I can see in the documentation that we can get the values from records, but only of those records that exist in a data model. But I cannot see in the documentation how to deal with KPIs.Does anyone know if is there a way to get the value of multiple KPIs with PyCelonis, pls?

Hello everyone,I want to restrict access to a specific column in a data model so that non-admins cannot see the values in that column or the column itself. Is there a way to achieve this using data permissions? Thank you!Best,Emilia

Hi all,I would like to export datapools as json using content-cli in the ML workbench in order to backup them in Git. I have created an API key in my profile and used it in a python script with content-cli pull data-pool --id data-pool-id, which successfully generated a json of the datapool.However, I don't want to do this with a user-based API key but with an Application key (created under admin&settings).When I run the same command using the Application key, I get the error "error: The provided team or api key is wrong."With get_celonis(api_token=“applicationkey”, key_type="APP_KEY") however, I can see the Application key and all its permissions.Is content-cli possible with an Application key and if so, how can I use it?

Hello Community,I need you help in using the PQL Function QUANTITY_CONVERTMy objective is simple: I want to convert the SAP Field LIPS.BTGEW to Tons (TO). The original Unit is stored in field LIPS.GEWEI.With this try I get an errorQUANTITY_CONVERT("LIPS"."BRGEW", FROM ("LIPS"."GEWEI"), TO ('TO'))A PQL error is preventing this query from executing.Syntax error near [)] after reading [QUANTITY_CONVERT("LIPS"."BRGEW", FROM ("LIPS"."GEWEI"), TO ('TO')] at line 32. Please refer to PQL documentation for available syntax. What's the problem? If I understand the docu (https://docs.celonis.com/en/quantity_convert.html) correctly, I must not provide a conversation rates table?This operator converts quantity units based on a QUANTITY_CONVERSION_RATES table, which is optionally provided by the user. If not provided by the user, a default QUANTITY_CONVERSION_RATES table will be used. Where can I see the contents of the default QUANTITY_CONVERSION_RATES table?Thanks for helpBest, Thomas 

I need to use a filter in my extraction, but the field in the table I'm bringing it from has a separate name "Date Archived" Example.When I use it like this "Date Archived" >= '2024-01-01 00:00:00', it doesn't load, I believe it's because of the space between the column name. Does anyone know how to solve this?I've tried to put the column as a parameter, but I still can't.