Data Ingestion & Infrastructure

Hi Community,I'm getting the following error while loading my data model:Could not execute foreign key join: there are duplicates on both sides of the specified key relationship.Table EKKO, key columns (MANDT, LIFNR), key ('011', '0000805024').What is the recommended best practice for resolving this issue?Should the duplicate records be removed, or should the join relationship be adjusted? If removing duplicates is the preferred approach, how do you typically handle it? I have already identified the duplicate records, so the only remaining step would be how to delete them.Thanks in advance for your insights and recommendations!

  If you have built any Object-Centric Data Models (OCDM) recently, you know the pain of handling tables that use composite primary keys.Previously, Celonis only allowed a single string ID as the primary key. If you were pulling tables from SAP (like VBAP), you had to write custom SQL transformations to concatenate keys (like VBELN and POSNR) into a single string ID just to make joins work.With the June 15, 2026 release, Celonis natively supports composite primary keys. You can now select multiple columns directly in the Objects and Events UI to form your primary key, completely bypassing the old SQL concatenation step.This change fixes three major issues.First, you don't have to write redundant CONCAT SQL code in your data jobs anymore. Your SQL transformations stay clean.Second, database joins run faster on raw composite columns than on concatenated string columns, especially when you are querying millions of rows.Third, your Celonis data model now matches your source ERP schema exac

Hi Guys,I am currently facing issues with the datapipeline between celonis studio and the machine learning workbench. The ML Workbench is unable to access Celonis data due to outdated celonis_ml dependencies that rely on deprecated sklearn functions. This breaks the built-in data pipeline and prevents direct data model access. As a workaround, data had to be exported manually as CSV and processed externally. An update to the ML environment and data connectors is required to restore full functionality.Is there a fix or a workaround for this?

hi all,Context :We have been using Celonis for many years connected to SAP ECC.To limit our data consumption + keep our jobs running as efficiently as possible, we have been extracting our tables based on a 24 months rolling basis.For that, we have a small job running every month setting the start date of all the extractions. This start date is used in the tables extraction filters. This has been running smoothly so far.What is happening :Our company is going to transition one ERP from SAP ECC to SAP S4.in SAP S4, the price conditions table PRCD_ELEMENTS (KONV table in SAP ECC) and more specifically the date field KDATU, is setup in CHAR data type. This is not compatible with our extraction setup.Assuming I wont be able to get this data type change, any recommendation on how to handle that?Thanks

We have multiple cases when we want to make sure there is an explicit correlation between two data series apart from visually representing those series on a graph. Is there any simple KPI/PQL formula we can use, or do we need to go with a workaround deriving corr from calculating standard deviations etc?

Hi, I’m currently facing an issue while setting up an Action Flow / Machine Learning Workbench solution to download and merge multiple Excel/CSV files from a SharePoint site.I can see that it’s possible to download a single file using the Microsoft SharePoint Online module in Action Flow. However, my problem is that the folder contains multiple files with different names, and I would like to handle all of them within one solution.Has anyone worked on something similar and could share some advice on how to approach this?

Dear experts , What is the size limit of Objects and Events in OCPM and  so far we have not consider archiving the older records from OCPM is it advisable ?  

I’m currently facing a challenge with copying objects and events created in one data pool to another data pool.How can this be done efficiently without recreating everything manually? Is there a recommended or best‑practice approach to reuse objects/events across data pools? Any tips to ensure consistency and minimal rework?If you’ve solved this before or know a better way, I’d really appreciate your insights. Thanks in advance!

Hi everyone,has anyone here worked with Coupa’s APIs — especially the requisition_revision_records and requisition_revision_record$requisition-lines APIs?Does anyone know if these are still supported by Coupa?Many thanks.

Hi - I am trying to write back the Variables I used in Studio View to Data Integration via an Action Flow but the attribute where I am storing the variable is showing as blank. I read Action Flows can’t read Variables form the Studio View. Is this true?

I’m trying to connect Celonis in Power BII created an Application Key but still don’t see any tables loaded after connectionWhat could be the issue? 

For testing some data, I just imported some manual files from my computer.After I click the ‘Add data connection’ button, and add the 2 files from my PC, I dont see anything in the window below.   

Hello everyone, As part of setting up a control tower, I am trying to gather as much information as possible to retrieve data from the platform via API calls. After combing through most of the existing documentation on the Celonis website, the pycelonis library documentation, and the freely accessible GitHub repositories, I am still having trouble identifying how to retrieve certain elements. For example, is there a way to get a list of all the pool ids of your environment (I know it’s possible using pycelonis but I’m not able to use private library in the external scheduler I’m using)?. Do you have comprehensive documentation of all possible API calls (in my case, with OAuth authentication. This is also one of my main concern: lot of API calls working with App Key are not working with OAuth2 identification, which is preferable)? I am interested in any resources I may have overlooked. Thank you for your help,Best regards, Alex

Hi everyone,I’m currently reviewing our extraction setup for Accounts Payable (AP) data and would love to hear from others about best practices that have proven effective across different organizations.Of course, I fully understand that every company’s landscape, compliance requirements, and data models are unique. Still, I believe there are common patterns and techniques that tend to work well in most AP extraction scenarios. I’d be very interested in your experience around the following topics:Extraction FrequencyHow often do you typically run delta extractions for AP (e.g., hourly, daily, near‑real‑time)? How frequently do you schedule full loads?Delta vs. Full Load StrategyWhich tables do you usually extract in full, and which ones are better handled via delta? Do you rely on timestamps such as creation date or change date for deltas?FiltersWhich common and robust filters do you use to reduce data volume without losing relevant AP data? Examples: company codes, fiscal years, docume

We can update augmented attributes via an Action flow, but is there a way to mass-update directly from PyCelonis?

We have extended several of the Celonis Catalog perspectives. As a result, we now have Data Model Loads for both the original perspective (e.g., perspective_celonis_AccountsPayable) and our customized version (perspective_custom_AccountsPayableExtended).For our operational use, we only need the extended version. Therefore, loading the original Celonis perspective is unnecessary. However, these automatically created Data Model Loads cannot be set to Enabled = false.Question:How can I deactivate or exclude the automatically generated Data Model Load for the standard Celonis perspective within the ocpm-data-job—without deleting the entire perspective?Any guidance or best practices would be appreciated.

Hello together,is there a way to (re-)load the data permission table automatically? Currently, it seems like that setting up a data permission table is only possible by manually clicking on the button ‘apply permission table’. I wonder if there is the possibility to schedule the load to automate this procedure.Has anyone experienced this problem and found a solution for it?Thanks! 

Hi Community,I’m working on an individual custom project (not based on any default Celonis template) and I’m facing an issue where no data is visible in Process Explorer, even though the data model and configurations appear to be correct. I’m looking for guidance on advanced or non-obvious checks specific to custom implementations.Project context This is an individual project No default Celonis template is used All event logs, case/object tables, and views are created manually What is already verified and working ✅ Event data is successfully loaded into the data pool ✅ Transformations execute without errors ✅ Data is visible in table preview after transformation ✅ Activity column is correctly configured and cross-checked ✅ Event-to-case (or event-to-object) relationship is correctly established ✅ Case/Object ID is present and populated ✅ Data model is published successfully The issue Process Explorer shows no cases / no activities No explicit error messages are displa

Hello,I am facing a somewhat specific problem with an Action Flow.I am using the Get rows module to retrieve, depending on the input variable, the column from one table or another. The variable directly affects the name of the table I am retrieving. No problem there; depending on the input parameter, the module behaves normally. The problem occurs in the next module, when I use the Text Aggregator to group the data according to this specific field. The name of the Get Rows module variable changes depending on the value of my input parameter. Here is what I tried to do, which works when the parameter is 1 but does not work when the input variable is 2.  Does anyone have any suggestions for this problem? Thank you, have a good evening. 

Hi!Is it possible to change the Data Source of the transformations of celonis objects (OCPM)?Background: we have migrated a formerly external instance into our Celonis. Therefor we do have several redundant data extractions. I would like to consolidate them in one common Data pool (seperat of the other data pools). This means that I have to change the Data Source of existing celonis objects. But it seems that the Data Source is read only, once an object is created. Is there any solution for that? ...up to now, my only idea is to create views in the old, original data source for each table, that is moved to the new common data extraction pool.

Hi!Today I noticed that there is a “Transpile” button in SQL editing, and I would like to know if there is any documentation about it as I haven’t been able to find any.  Thankyou for your time

Over the Join Functionality documentation page (Join functionality (celonis.com)), when we get an 'No Common Table' error message - a detailed explanation along with the join path is explained. As I am new to the Celonis world, I wonder how to use the mentioned path to achieve the corresponding result.  Thanks in advance.

Hi! How can I access dummy data to help with my build of my App? End goal is this app will be sold on Marketplace. I would need data for all of the core processes. 

Hi everyone,we are currently restructuring our data architecture in Celonis. For each process area (P2P, AP, AR), we have separate data pools where we extract, transform, and load the respective data models.In the AP area, we already use a dedicated Central Extraction Pool, which only handles the extraction of raw tables. The actual AP data pool then receives these extracted tables and performs the transformations.Now, we want to extend this concept gradually to other areas. For example, we plan to stop extracting the CDPOS table in the Purchasing Pool and instead consume it from the Central Pool. This step-by-step migration should help us reduce redundancy and improve maintainability.However, I have a specific question regarding this setup: If I start consuming tables from the Central Pool in the Purchasing Pool (e.g., CDPOS), what happens to other tables like EKKO, which are still being extracted directly in the Purchasing Pool?Will my transformations in the Purchasing Pool use the l

Hi Community,I’m working on cleaning up our data pools in OCPM, which currently include:Migrated CPM → OCPM pools New OCPM pools Pools that extract data directly from source systems Pools that combine multiple source extractions Derived data pools (with filters, perspectives, etc.)What is a good way to organize or separate these different types of data pools? Specifically:Is there a recommended approach to distinguish source-based pools from combined or derived pools? Are there best practices for naming conventions to make it easier to manage and identify them? How can I easily see which data pools are connected to which assets (apps, views, packages)?Any guidance or examples would be greatly appreciated!Thanks in advance,ShalinI am aware of this question, but it was posted a while ago and does not provide the granularity I am looking for🙁https://community.celonis.com/topic/show?tid=4263&fid=2