Data Ingestion & Infrastructure

Hello everyone, As part of setting up a control tower, I am trying to gather as much information as possible to retrieve data from the platform via API calls. After combing through most of the existing documentation on the Celonis website, the pycelonis library documentation, and the freely accessible GitHub repositories, I am still having trouble identifying how to retrieve certain elements. For example, is there a way to get a list of all the pool ids of your environment (I know it’s possible using pycelonis but I’m not able to use private library in the external scheduler I’m using)?. Do you have comprehensive documentation of all possible API calls (in my case, with OAuth authentication. This is also one of my main concern: lot of API calls working with App Key are not working with OAuth2 identification, which is preferable)? I am interested in any resources I may have overlooked. 

Hi everyone,I’m currently reviewing our extraction setup for Accounts Payable (AP) data and would love to hear from others about best practices that have proven effective across different organizations.Of course, I fully understand that every company’s landscape, compliance requirements, and data models are unique. Still, I believe there are common patterns and techniques that tend to work well in most AP extraction scenarios. I’d be very interested in your experience around the following topics:Extraction FrequencyHow often do you typically run delta extractions for AP (e.g., hourly, daily, near‑real‑time)? How frequently do you schedule full loads?Delta vs. Full Load StrategyWhich tables do you usually extract in full, and which ones are better handled via delta? Do you rely on timestamps such as creation date or change date for deltas?Filters

We can update augmented attributes via an Action flow, but is there a way to mass-update directly from PyCelonis?

We have extended several of the Celonis Catalog perspectives. As a result, we now have Data Model Loads for both the original perspective (e.g., perspective_celonis_AccountsPayable) and our customized version (perspective_custom_AccountsPayableExtended).For our operational use, we only need the extended version. Therefore, loading the original Celonis perspective is unnecessary. However, these automatically created Data Model Loads cannot be set to Enabled = false.Question:How can I deactivate or exclude the automatically generated Data Model Load for the standard Celonis perspective within the ocpm-data-job—without deleting the entire perspective?Any guidance or best practices would be appreciated.

Hello together,is there a way to (re-)load the data permission table automatically? Currently, it seems like that setting up a data permission table is only possible by manually clicking on the button ‘apply permission table’. I wonder if there is the possibility to schedule the load to automate this procedure.Has anyone experienced this problem and found a solution for it?Thanks! 

Hi Community,I’m working on an individual custom project (not based on any default Celonis template) and I’m facing an issue where no data is visible in Process Explorer, even though the data model and configurations appear to be correct. I’m looking for guidance on advanced or non-obvious checks specific to custom implementations.Project context This is an individual project No default Celonis template is used All event logs, case/object tables, and views are created manually What is already verified and working ✅ Event data is successfully loaded into the data pool ✅ Transformations execute without errors ✅ Data is visible in table preview after transformation ✅ Activity column is correctly configured an

Hello,I am facing a somewhat specific problem with an Action Flow.I am using the Get rows module to retrieve, depending on the input variable, the column from one table or another. The variable directly affects the name of the table I am retrieving. No problem there; depending on the input parameter, the module behaves normally. The problem occurs in the next module, when I use the Text Aggregator to group the data according to this specific field. The name of the Get Rows module variable changes depending on the value of my input parameter. Here is what I tried to do, which works when the parameter is 1 but does not work when the input variable is 2.  

Hi - I am trying to write back the Variables I used in Studio View to Data Integration via an Action Flow but the attribute where I am storing the variable is showing as blank. I read Action Flows can’t read Variables form the Studio View. Is this true?

Hi!Is it possible to change the Data Source of the transformations of celonis objects (OCPM)?Background: we have migrated a formerly external instance into our Celonis. Therefor we do have several redundant data extractions. I would like to consolidate them in one common Data pool (seperat of the other data pools). This means that I have to change the Data Source of existing celonis objects. But it seems that the Data Source is read only, once an object is created. Is there any solution for that? ...up to now, my only idea is to create views in the old, original data source for each table, that is moved to the new common data extraction pool.

Hi!Today I noticed that there is a “Transpile” button in SQL editing, and I would like to know if there is any documentation about it as I haven’t been able to find any.  Thankyou for your time

Over the Join Functionality documentation page (Join functionality (celonis.com)), when we get an 'No Common Table' error message - a detailed explanation along with the join path is explained. As I am new to the Celonis world, I wonder how to use the mentioned path to achieve the corresponding result.  Thanks in advance.

Hi! How can I access dummy data to help with my build of my App? End goal is this app will be sold on Marketplace. I would need data for all of the core processes. 

Hi everyone,we are currently restructuring our data architecture in Celonis. For each process area (P2P, AP, AR), we have separate data pools where we extract, transform, and load the respective data models.In the AP area, we already use a dedicated Central Extraction Pool, which only handles the extraction of raw tables. The actual AP data pool then receives these extracted tables and performs the transformations.Now, we want to extend this concept gradually to other areas. For example, we plan to stop extracting the CDPOS table in the Purchasing Pool and instead consume it from the Central Pool. This step-by-step migration should help us reduce redundancy and improve maintainability.However, I have a specific question regarding this setup: If I start consuming tables from the Central Pool in the Purchasing Pool (e.g., CDPOS), what happens to other tables like EKKO, which are still being extracted directly in the Purchasing Pool?Will my transformat

Hi Community,I’m working on cleaning up our data pools in OCPM, which currently include:Migrated CPM → OCPM pools New OCPM pools Pools that extract data directly from source systems Pools that combine multiple source extractions Derived data pools (with filters, perspectives, etc.)What is a good way to organize or separate these different types of data pools? Specifically:Is there a recommended approach to distinguish source-based pools from combined or derived pools? Are there best practices for naming conventions to make it easier to manage and identify them? How can I easily see which data pools are connected to which assets (apps, views, packages)?Any guidance or examples would be greatly appreciated!Thanks in advance,ShalinI am aware

Hello,I am trying to get data from a Microsoft sharepoint list to the Celonis Platform.According to the Flowchart provided by the API-Team - When to use the Standard Data Ingestion API (and other methods) - the extractor builder should be used for a Sharepoint data transfer, since the REST API is exposed.I tried to set up the connection, but I fail when configuring the endpoint, since I get xml-data even if I specify that I would like to have a json structure (Request Parameter - Accept: application/json;odata=verbose)Does anyone have experience with connecting the MS universe with the Celonis universe?I also found a workaround that works (Push CSV to Data Integration), but I would rat

Hi everyone,has anyone here worked with Coupa’s APIs — especially the requisition_revision_records and requisition_revision_record$requisition-lines APIs?Does anyone know if these are still supported by Coupa?Many thanks.

Hi all,I have a question relating to “hygiene” in data pools.In my organisation we use manual data ingestion and upload files into our data pools. Over time, a large number of files and tables was added and created. I’d like to do a bit of house-keeping and remove obsolete/ unused files. How can I do that? I have analyst access.I look forward to hearing from you. Thanks.Kind regards,Vladimir

Dear community, I would like to set up a data pool parameter to allow me to switch between test and prod environment? So I would need two global variables for my data jobs:var_data_source: to allow me switch between test schema and prod schema var_table_name: to allow me when creating table to add _test at the end of the table nameI have only found the way to create parameters in EACH data job under transformation and refer to the data pool parameter. Is there a smarter way? I am still using the data integration (not OCPM). Thanks a lot!   

Hi There,We’d like to integrate our Celonis (SaaS) solution to one of our other cloud applications (ServiceNOW) using the other application’s REST API. We need to deploy a VPN for this integration to ensure secure communication. Does Celonis SaaS (or the underlying platform Azure/Amazon) provide a means for deploying a VPN? e.g. Azure VPN Gateway or AWS Transit Gateway Kind Regards, Seamus

Has anyone experience on connecting Celonis with SAP Business One (BOne)?How easy is the connection? 

Hello all, I’m currently working on combining various cycle times (e.g. from PO Item creation to Goods Receipt, or from Goods Receipt to Invoice Receipt) with key figures from my Case Table in a single OLAP table.To achieve this, I’ve tested two different approaches:Cycle Time Calculation Based on the Activity Table: This method allows me to control which occurrence to consider — for example, in cases of multiple GRNs for the same PO line, I can choose to include only the first one. The formula delivers the expected results. However, I’m unable to combine this approach with other key figures from my Case Table (e.g. Company Code, PO Item Count, etc.) in the same OLAP table. Additionally, if the cycle time is negative (e.g. GRN before PO Item creation), the formula returns “–” instead of the actual negative value.   AVG(CALC_THROUGHPUT ( F

Good day, I have an OCPM data model with 2 objects, a case and a user. I need to select my case eventlog as the default eventlog. How do I do that? I know I can create an eventlog in Perspectives and make it the default eventlog but I dont want to create an additional eventlog , I want to select the existing case eventlog as the default eventlog. Thank you

Hello everyone, I’m trying to use Action Flow to trigger chained data jobs, meaning job A is executed, once it’s done job B is executed, once it’s done job C is executed. Ideally, I would like to launch Data Model Schedule from Action Flow, but I’m only able to launch data jobs and load data model. What I’ve done so far is: 1. Creating json file with all my jobs ID (A,B,C) - Parse Json Module2. Creating a POST request using API Celonis Key, to access data pool and launch jobs, load data model -    HTTP Make a request Module3. Using Iterator module to repeat step 2 for all job IDThe issue I’m facing is, job A need to be completed before launching job B and same for job B and C (this is what I’m calling chained data jobs). Configuring a Sleep in the iterator loop greater than the running time of my jobs is working, but not optimized. My question is: Do you know

Hey all,I have a process where I have four activities labeled: A, B, C, D.In the event log I have for one case equal timestamps for B and C: 08:11:00 until 08:23:00.My problem is that Celonis visualizes this process as A → B → C → D, however I expect the process to look like A → B, C → D. Is there any way to do this, and if so, how?

Does anyone have the steps to do the data integration with the Dynamics 365 for order to cash process?