- - Knowledge base overview
Product Updates

Welcome to the Celonis Community

3 months ago

Home
Community
Product Q&A
Data Ingestion & Infrastructure

Data Ingestion & Infrastructure

Discuss and ask questions about data integration, task mining, admin settings, and PQL extractors to optimize your infrastructure.

764 Topics
2,051 Replies

When you subscribe we will email you when there is a new topic in this category

764 Topics

Most replies

Most views

Newest first

kenneth.mcgra12Level 2

asked in Data Ingestion & Infrastructure

Trying to calculate difference in stock value between dates

HI, as a newbie to PQL, I am would need help in order to calculate the different in stock levels between two months. The current display shows the SUM of the stock, with a Component Filter the particular month. How could I calculate the difference between the starting stock (January) and the current stock level, by month? (there are multiple stock items)ThanksKenny7

3 years ago

jan.heinrLevel 2

asked in Data Ingestion & Infrastructure

Filter option for business user for a value range

Hi,i do have trouble implementing implenting a filter. I want the to give the business user the chance to filter for a value range.the column looks like:x001x002x003y001y002z001At the moment there is a button dopdown - but there is the need to look up a range, e.g. x050-x080 which are to many values to be selected manually.My idea was to let the user set the minimum and maximum value via input fields and use those values as a sheet filter but variables can not be used in sheet filters.Does someone have an idea?Best regards,Jan

3 years ago

dom.tLevel 2

asked in Data Ingestion & Infrastructure

Throughput time for sub-activity

Hi team,i have an activity table as follow:activity_table(Case ID, Category, Activity, Timestamp)A, Red, Activity 1, Jan 1 2020A, Red, Activity 2, Jan 2 2020A, Red, Activity 3, Jan 3 2020A, Blue, Activity 4, Jan 10 2020A, Blue, Activity 5, Jan 31 2020B, Red, Activity 1, Jan 5 2020B, Red, Activity 2, Jan 10 2020Is there a way that i can aggregate the average throughput time per category to get the following result:Red --> (3 + 5) / 2 = 4 daysBlue --> 21 daysBest,Dominic

3 years ago

joão.filipLevel 2

asked in Data Ingestion & Infrastructure

Throughput Time to nth occurence of activity

Hi everyone,Im having some trouble finding out how to implement a throughput time KPI.How do i calculate, for example, the throughput time from the first occurence of an activity to the second occurence of another activity?The goal with this would be to compare activity changes and check which take the most time.Thanks a lot in advance!Joo

3 years ago

benedikt.tiege12Level 2

asked in Data Ingestion & Infrastructure

Configure (source) Database connections at one point

Hi, we are using Celonis Version 4.5 on premise. Is there any chance to configure Database connections parameters at one singel Point? At the moment every project has its own definition. Because our Database user password has to be changed frequently this is quite unhandy. kind regards Benedikt

3 years ago

janpeter.van.dLevel 8

posted in Data Ingestion & Infrastructure

Handle uncommon JSON formats in Extraction Builder

Handle uncommon JSON formats in Extraction Builder Hi all, We are working with the Extraction Builder, but unfortunately the API we are using returns slightly adjusted JSON-formats. Format 1 is Newline delimited JSON (application/x-ndjson), where entries are delimited with a newline (\\n) character.Format 2 is a multipart results, with a combination of plain-text and JSON, see example below Is there a way to handle such results in Celonis, without creating parser using Python in the Machine Learning Workbench?Thanks in advance! Jan-peter ----Multipart response example:`--Boundary_1141620_1164068888_1623858255903Content-Encoding: identitydl_compression_type: deflateddl_document_date: 2021-02-11T15: 13: 52.988Zdl_corrupt: falsedl_size: 1024dl_encoding: UTF-8dl_document_data_type: JSON { "compnr": 8010, "orderno": "XX0000024", "buspart": "P00000001", ... ...}`

3 years ago

david.van.d11Level 3

asked in Data Ingestion & Infrastructure

Delta extract from a REST API - How to include max date in the API query

Hi All We have created a custom REST API to pull data into Celonis. This is working well for full data extractions. How do we create and use a variable within the API rest query to enable delta extract? ie. We want a way to replace the text in {{}} with the last date within the datamodel: http://xxx.service-now.com/api/now/table/sys_audit?sysparm_display_value=true&sysparm_query=tablename=interaction^sys_created_on>javascript:gs.dateGenerate({{MAX DATE FROM MODEL}}','00:00:00')^ORDERBYsys_created_on&sysparm_offset=0&sysparm_limit=1000 thanksDavid

3 years ago

bruhathi.reddy12Level 1

asked in Data Ingestion & Infrastructure

connecting uipath using API Key

3 years ago

Anonymous

asked in Data Ingestion & Infrastructure

I'm stuck doing the celonis Implementation Track training. Specifically, I don't understand when I have to use a STRING or DATE when applying filters. It seems to me there is a bug here but I am not sure. Sorry but THIS IS A VERY LONG POST.

Imprementation TrackProcess Connection Basics Exercise: Extract Data - Create Extraction TRAINING.EKKO Suggested solution: EKKO.AEDAT >= '01.06.2014’ Configure columns: AEDAT == STRING Extraction Preview: AEDAT(1) == 2016-05-02 00:00:00.0 Doesn’t work:1. EKKO.AEDAT >= '01.06.2014’2. EKKO.AEDAT >= '2014-06-01 00:00'3. EKKO.AEDAT >= '2014-06-01 00:00:00.0' Filter contains a data type mismatch. Column "AEDAT" has data type: " DATETIME". You supplied an value of type: "STRING". Please adjust your value. 4. AEDAT >= DATETIME('2014-06-01 00:00:00.0') Error parsing filter: AEDAT >= DATETIME('2014-06-01 00:00:00.0') caused by: Encountered " <LIST_STRING> "(\\'2014-06-01 00:00:00.0\\') "" at line 1, column 18. Was expecting one of: <EOF> "AND" ... "OR" ... 5 . AEDAT >= DATE('201

3 years ago

arnold.kinzeLevel 1

asked in Data Ingestion & Infrastructure

Convert to parquet failed. The following chunks could not be processed:

Hello, Celonis community and team, this is our first C4C project. We have provided the client with a Celonis ABAP-Skript and used the SAP ABAP Output Uploader. In the third stage Processing, some of the 86 SAP tables could not be processed. The following issues arise for the respective tables: EINA: Convert to parquet failed. The following chunks could not be processed: EINA_1_20201203_155035.csv, EINA_1_20201203_154720.csv, EINA_0_20201203_155035.csv, EINA_0_20201203_154720.csv EINE: Convert to parquet failed. The following chunks could not be processed: EINE_1_20201203_155048.csv, EINE_0_20201203_154734.csv, EINE_0_20201203_155048.csv MARC: Convert to parquet failed. The following chunk could not be processed: MARC_2_20201204_080156.csv MSEG: Convert to parquet failed. The following chunk could not be processed: MSEG_93_20201204_102543.csv T023UT: Job failed T16FE: Job failed What could be the reasons for these issues? The tables incurring the error Convert to parquet failed. The fol

3 years ago

madhava.pemmaLevel 2

asked in Data Ingestion & Infrastructure

Mapping of Celonis Activities with SAP activities

Can anyone has this mapping information?I would like to see the list that shows the mapping of Celonis activities (eg: AP process) to SAP tables.Like while calculating the clear invoice steps which tables, timestamps are used in SAP. Similarly for other activities. This will be a good reference document to begin with and help to customize the activities in Celonis if we need to do so.Appreciate your inputs here.

3 years ago

alexander.grafLevel 3

asked in Data Ingestion & Infrastructure

Howto: Access system parameters

Hey,I want to access some system parameters like logged in users language and last successful dataload. Is there any possibility to do that?Kind regardsAlex

3 years ago

.14600927Level 1

asked in Data Ingestion & Infrastructure

P2P demo data to a pandas dataframe

Hello, I am trying to use the demo P2P data as a pandas dataframe throught the ML Workbench. Following the documentation : from pycelonis import get_celonis login = { celonis_url : url api_token : token } celonis = get_celonis(**login) out pycelonis: Login successful! Hello vasilis <pycelonis.api.IBC at 0x7f6cb9719340> celonis.workspaces out <Workspace, id 0036fb70-61e7-4e8e-92d3-4aeac9d563bd, name Purchase To Pay Demo Analysis> Then when i try to find the analysis i get " No result found for id : xxx" analysis = celonis.analyses.find(0036fb70-61e7-4e8e-92d3-4aeac9d563bd) Any hints how to get the OLAP table of the P2P demo data to a pandas dataframe?

3 years ago

.14600774Level 3

asked in Data Ingestion & Infrastructure

Migrate Data model from Celonis 4 to IBC

Dear all, Is there any way to migrate a data model from Celonis 4 to IBC using pycelonis? Otherwise is there any method to convert a data model object to data frame to use the function push_table? Thank you in advance

3 years ago

daniel.diers12Level 3

asked in Data Ingestion & Infrastructure

Delete table then table pops up again (deletion nearly not possible)

Hi all, I have a big problem. I have several CSV/xlsx-filles uploaded as tables to my data model. When I try to delete one table (e.g. in data model under Tables) I click in Edit and then Remove table. After done that the table is gone, but ca. 10-12 seconds later the table comes back, magic. If I click it several times, sometimes the table is gone then. At the buttom of the Tables list there are then created several new tables like that Auswahl_Delta.xlsx_0_0_0_2_0_1_0_0_0_0_0_2 What can I do to solve that? What is going wrong? Please help me. Thx and br Daniel

3 years ago

rob.buijtLevel 2

asked in Data Ingestion & Infrastructure

Unit4 Business World financial ERP

In our company we use Unit4 Business World for our transactional services (OtC, RtR, PtP). Is there any experience within the community with connecting real time to the Unit4 Business World database?

3 years ago

jacob.visse12Level 2

asked in Data Ingestion & Infrastructure

Connecting Mendix to EMS

We want to make a connection to a Mendix platform which is hosted in the Mendix on AWS from our EMS. The Mendex documentation shows that the following endpoints are possible: Soap Rest Odata Is there anybody who has done this already?

3 years ago

nogueira.nogueLevel 3

asked in Data Ingestion & Infrastructure

(IBC) Specific ADMIN profile for Team Settings and Configuration

Hi, Everyone. Is there any way to give access to some users just for Team Settings and Configuration purposes? At my company the IT teams are responsible for making applications work but dont have access to the information in them. In fact different teams are responsible for different tasks like user configuration, permission configuration or server configuration. So, what would be nice was some kind of CONFIGURATION role where I, as ADMIN, could decide which users can do what, under the Team Settings menus (could be different permissions for each submenu), but nothing else. Thank you. Joaquim

3 years ago

vivek.mLevel 4

posted in Data Ingestion & Infrastructure

Hi Task Mining Experts,

Hi Task Mining Experts, Question :During Testing Task Mining on Sandbox, I have added few users and facing data limitation. It is related to table rows count and the standard issue. Error Message :Data model load failed during table export: Data model tables: user_interaction_event_log contain more rows than the allowed maximum per table of 10000. Please reduce the number of rows. Any inputs to increase the rows count more than 10000 ? RegardsVivek M

3 years ago

ashish.petkaLevel 2

posted in Data Ingestion & Infrastructure

Task Mining members,

Task Mining members, I am facing 2 issues for the past couple of days, would be helpful if you can suggest a solution. 1) While trying to create a quickstart project with template, after entering the name of task mining project, I get error that "Project cannot be created because it fails to connect servers" and I had been trying this for couple of days now facing the same issue. 2) Another issue is, I tried to create a project with blank template and completed tasks capture and screenshots caputre using task mining client, and it shows upload successful. But when I go to data model, it shows no data uploaded and then when I try to do force upload from cache or complete force upload, it gives errorMessage :Data model load failed during table export: Data model tables could not be exported: user_interaction_event_log It will be a great help if someone can provide a resolution to this issues.

3 years ago

.146001040Level 2

posted in Data Ingestion & Infrastructure

taskmining_error

Hi, Task mining experts I have tried to create a Task Mining project, and I had several issues:-"New Project with template" it is not working: see attached screenshot-When I create a "New Blank Project", after following the instructions to download and setup the "Task Mining client" using the "Configuration" utility, everything seems to be ok, but the client seems to fail when uploadind data to the server, because I can't see no data non analysis its automatically created. I have checked in my PC that the screenshots and parquet file are created. I have even checked using different PCs as clients, as you can see in the attached "Users and Invite" screenshot. The client without errors seems not to be able to upload data...and even worse, Im not able to see the errors reported by the other client "oscar.vinan".-The celonis snap server seems not to detect the chrome plugin I have installed. Could you so kindly please help or

3 years ago

lingzhi.lingzLevel 2

asked in Data Ingestion & Infrastructure

System objects in Event collection

Is there any system tables in Celonis we can check, for example, in Oracle, we have all_objects, user_tables such kind of tables we can have an overview understanding for one DB

3 years ago

james.stronLevel 1

asked in Data Ingestion & Infrastructure

ServiceNow Change Management Data Model

Hello, Is anyone able to share insight into what a ServiceNow Change Management Data Model might look like, i.e. which standard tables are involved and perhaps an example of the associated activity table? What is your experience with using the ServiceNow Change Management Connector and Apps? Appreciate any information or tips, Regards, James

3 years ago

michael.gordoLevel 2

asked in Data Ingestion & Infrastructure

Ariba Invoice Pro

Hi Has anyone created a data model with Ariba Invoice Pro? Ariba Invoice Pro has a separate child realm to Ariba itself If you can help I have two questions Are there any prebuilt connections / apps for Ariba Invoice Pro? Assume this would require 2 data extractions - one for Ariba and one for Ariba Invoice Pro Many thanks Michael

3 years ago

tomasz.wrobe11Level 2

asked in Data Ingestion & Infrastructure

Apply Permission Table in Data Model using python

Hello, Is it possible to automate with python Apply Permission Table option in data model data permissions.

3 years ago

Page 18 / 31

Badge winners

bruno.carva11has earned the badge Qualified to Write PQL Queries
tim.sandehas earned the badge Qualified to Build Action Flows
bruno.carva11has earned the badge Qualified to Build Action Flows
bruno.carva11has earned the badge Qualified to Build Views
bruno.carva11has earned the badge Qualified to Build Analyses

Show all badges

Terms & Conditions

Sign up

Already have an account? Login

Login with SSO

Celonaut Login Celonis ID Login

Login to the community

Login with SSO

Celonaut Login Celonis ID Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

ANY QUESTION?

Talk to an expert

FAQs

MORE CELONIS

Academy arrow_outward

Documentation arrow_outward

Support Center arrow_outward

Partner Portal arrow_outward

Marketplace arrow_outward

CHECK US IN

YouTube

Instagram

Facebook