Skip to main content

Data Ingestion & Infrastructure

Discuss and ask questions about data integration, task mining, admin settings, and PQL extractors to optimize your infrastructure.

  • 809 Topics
  • 2,126 Replies
809 Topics
D
Level 2
dom.tLevel 2
asked in Data Ingestion & Infrastructure
Throughput time for sub-activity

Hi team,i have an activity table as follow:activity_table(Case ID, Category, Activity, Timestamp)A, Red, Activity 1, Jan 1 2020A, Red, Activity 2, Jan 2 2020A, Red, Activity 3, Jan 3 2020A, Blue, Activity 4, Jan 10 2020A, Blue, Activity 5, Jan 31 2020B, Red, Activity 1, Jan 5 2020B, Red, Activity 2, Jan 10 2020Is there a way that i can aggregate the average throughput time per category to get the following result:Red --> (3 + 5) / 2 = 4 daysBlue --> 21 daysBest,Dominic

00
K
Level 1
J
Level 2
joão.filipLevel 2
asked in Data Ingestion & Infrastructure
Throughput Time to nth occurence of activity

Hi everyone,Im having some trouble finding out how to implement a throughput time KPI.How do i calculate, for example, the throughput time from the first occurence of an activity to the second occurence of another activity?The goal with this would be to compare activity changes and check which take the most time.Thanks a lot in advance!Joo

40
gabriel.okaba11
Celonaut
B
Level 2
benedikt.tiege12Level 2
asked in Data Ingestion & Infrastructure
Configure (source) Database connections at one point

Hi, we are using Celonis Version 4.5 on premise. Is there any chance to configure Database connections parameters at one singel Point? At the moment every project has its own definition. Because our Database user password has to be changed frequently this is quite unhandy. kind regards Benedikt

00
gabriel.okaba11
Celonaut
janpeter.van.d
Level 8
janpeter.van.dLevel 8
posted in Data Ingestion & Infrastructure
Handle uncommon JSON formats in Extraction Builder

Handle uncommon JSON formats in Extraction Builder Hi all,  We are working with the Extraction Builder, but unfortunately the API we are using returns slightly adjusted JSON-formats. Format 1 is Newline delimited JSON (application/x-ndjson), where entries are delimited with a newline (\\n) character.Format 2 is a multipart results, with a combination of plain-text and JSON, see example below Is there a way to handle such results in Celonis, without creating parser using Python in the Machine Learning Workbench?Thanks in advance! Jan-peter ----Multipart response example:`--Boundary_1141620_1164068888_1623858255903Content-Encoding: identitydl_compression_type: deflateddl_document_date: 2021-02-11T15: 13: 52.988Zdl_corrupt: falsedl_size: 1024dl_encoding: UTF-8dl_document_data_type: JSON {  "compnr": 8010,  "orderno": "XX0000024",  "buspart": "P00000001", ... ...}`

04
janpeter.van.d
Level 8
D
Level 3
david.van.d11Level 3
asked in Data Ingestion & Infrastructure
Delta extract from a REST API - How to include max date in the API query

Hi All  We have created a custom REST API to pull data into Celonis. This is working well for full data extractions. How do we create and use a variable within the API rest query to enable delta extract? ie. We want a way to replace the text in {{}} with the last date within the datamodel: http://xxx.service-now.com/api/now/table/sys_audit?sysparm_display_value=true&sysparm_query=tablename=interaction^sys_created_on>javascript:gs.dateGenerate({{MAX DATE FROM MODEL}}','00:00:00')^ORDERBYsys_created_on&sysparm_offset=0&sysparm_limit=1000 thanksDavid

60
D
Level 3
B
Level 1
bruhathi.reddy12Level 1
asked in Data Ingestion & Infrastructure
connecting uipath using API Key

connecting uipath using API Key

50
S
Level 1
A
Anonymous
asked in Data Ingestion & Infrastructure
I'm stuck doing the celonis Implementation Track training. Specifically, I don't understand when I have to use a STRING or DATE when applying filters. It seems to me there is a bug here but I am not sure. Sorry but THIS IS A VERY LONG POST.

Imprementation TrackProcess Connection Basics  Exercise: Extract Data - Create Extraction TRAINING.EKKO Suggested solution: EKKO.AEDAT >= '01.06.2014’ Configure columns: AEDAT == STRING Extraction Preview: AEDAT(1) ==  2016-05-02 00:00:00.0 Doesn’t work:1.     EKKO.AEDAT >= '01.06.2014’2.    EKKO.AEDAT >= '2014-06-01 00:00'3.    EKKO.AEDAT >= '2014-06-01 00:00:00.0' Filter contains a data type mismatch. Column "AEDAT" has data type: " DATETIME". You supplied an value of type: "STRING". Please adjust your value. 4.    AEDAT >= DATETIME('2014-06-01 00:00:00.0') Error parsing filter: AEDAT >= DATETIME('2014-06-01 00:00:00.0') caused by: Encountered " <LIST_STRING> "(\\'2014-06-01 00:00:00.0\\') "" at line 1, column 18. Was expecting one of: <EOF> "AND" ... "OR" ... 5 .  AEDAT >= DATE('201

100
A
A
Level 1
arnold.kinzeLevel 1
asked in Data Ingestion & Infrastructure
Convert to parquet failed. The following chunks could not be processed:

Hello, Celonis community and team, this is our first C4C project. We have provided the client with a Celonis ABAP-Skript and used the SAP ABAP Output Uploader. In the third stage Processing, some of the 86 SAP tables could not be processed. The following issues arise for the respective tables: EINA: Convert to parquet failed. The following chunks could not be processed: EINA_1_20201203_155035.csv, EINA_1_20201203_154720.csv, EINA_0_20201203_155035.csv, EINA_0_20201203_154720.csv EINE: Convert to parquet failed. The following chunks could not be processed: EINE_1_20201203_155048.csv, EINE_0_20201203_154734.csv, EINE_0_20201203_155048.csv MARC: Convert to parquet failed. The following chunk could not be processed: MARC_2_20201204_080156.csv MSEG: Convert to parquet failed. The following chunk could not be processed: MSEG_93_20201204_102543.csv T023UT: Job failed T16FE: Job failed What could be the reasons for these issues? The tables incurring the error Convert to parquet failed. The fol

10
J
Level 1
A
Level 3
alexander.grafLevel 3
asked in Data Ingestion & Infrastructure
Howto: Access system parameters

Hey,I want to access some system parameters like logged in users language and last successful dataload. Is there any possibility to do that?Kind regardsAlex

00
J
Level 1
.
Level 1
.14600927Level 1
asked in Data Ingestion & Infrastructure
P2P demo data to a pandas dataframe

Hello, I am trying to use the demo P2P data as a pandas dataframe throught the ML Workbench. Following the documentation : from pycelonis import get_celonis login = { celonis_url : url api_token : token } celonis = get_celonis(**login) out pycelonis: Login successful! Hello vasilis <pycelonis.api.IBC at 0x7f6cb9719340> celonis.workspaces out <Workspace, id 0036fb70-61e7-4e8e-92d3-4aeac9d563bd, name Purchase To Pay Demo Analysis> Then when i try to find the analysis i get " No result found for id : xxx" analysis = celonis.analyses.find(0036fb70-61e7-4e8e-92d3-4aeac9d563bd) Any hints how to get the OLAP table of the P2P demo data to a pandas dataframe?

40
J
Level 1
.
Level 3
.14600774Level 3
asked in Data Ingestion & Infrastructure
Migrate Data model from Celonis 4 to IBC

Dear all, Is there any way to migrate a data model from Celonis 4 to IBC using pycelonis? Otherwise is there any method to convert a data model object to data frame to use the function push_table? Thank you in advance

00
J
Level 1
D
Level 3
daniel.diers12Level 3
asked in Data Ingestion & Infrastructure
Delete table then table pops up again (deletion nearly not possible)

Hi all, I have a big problem. I have several CSV/xlsx-filles uploaded as tables to my data model. When I try to delete one table (e.g. in data model under Tables) I click in Edit and then Remove table. After done that the table is gone, but ca. 10-12 seconds later the table comes back, magic. If I click it several times, sometimes the table is gone then. At the buttom of the Tables list there are then created several new tables like that Auswahl_Delta.xlsx_0_0_0_2_0_1_0_0_0_0_0_2 What can I do to solve that? What is going wrong? Please help me. Thx and br Daniel

20
J
Level 1
R
Level 2
rob.buijtLevel 2
asked in Data Ingestion & Infrastructure
Unit4 Business World financial ERP

In our company we use Unit4 Business World for our transactional services (OtC, RtR, PtP). Is there any experience within the community with connecting real time to the Unit4 Business World database?

10
J
Level 1
J
Level 2
jacob.visse12Level 2
asked in Data Ingestion & Infrastructure
Connecting Mendix to EMS

We want to make a connection to a Mendix platform which is hosted in the Mendix on AWS from our EMS. The Mendex documentation shows that the following endpoints are possible: Soap Rest Odata Is there anybody who has done this already?

90
J
Level 1
N
Level 3
nogueira.nogueLevel 3
asked in Data Ingestion & Infrastructure
(IBC) Specific ADMIN profile for Team Settings and Configuration

Hi, Everyone. Is there any way to give access to some users just for Team Settings and Configuration purposes? At my company the IT teams are responsible for making applications work but dont have access to the information in them. In fact different teams are responsible for different tasks like user configuration, permission configuration or server configuration. So, what would be nice was some kind of CONFIGURATION role where I, as ADMIN, could decide which users can do what, under the Team Settings menus (could be different permissions for each submenu), but nothing else. Thank you. Joaquim

10
J
Level 1
V
Level 4
vivek.mLevel 4
posted in Data Ingestion & Infrastructure
Hi Task Mining Experts,

Hi Task Mining Experts,  Question :During Testing Task Mining on Sandbox, I have added few users and facing data limitation. It is related to table rows count and the standard issue. Error Message :Data model load failed during table export: Data model tables: user_interaction_event_log contain more rows than the allowed maximum per table of 10000. Please reduce the number of rows. Any inputs to increase the rows count more than 10000 ? RegardsVivek M

41
J
Level 1
A
Level 2
ashish.petkaLevel 2
posted in Data Ingestion & Infrastructure
Task Mining members,

Task Mining members, I am facing 2 issues for the past couple of days, would be helpful if you can suggest a solution. 1) While trying to create a quickstart project with template, after entering the name of task mining project, I get error that "Project cannot be created because it fails to connect servers" and I had been trying this for couple of days now facing the same issue. 2) Another issue is, I tried to create a project with blank template and completed tasks capture and screenshots caputre using task mining client, and it shows upload successful. But when I go to data model, it shows no data uploaded and then when I try to do force upload from cache or complete force upload, it gives errorMessage :Data model load failed during table export: Data model tables could not be exported: user_interaction_event_log It will be a great help if someone can provide a resolution to this issues.

21
J
Level 1
.
Level 2
.146001040Level 2
posted in Data Ingestion & Infrastructure
taskmining_error

Hi, Task mining experts I have tried to create a Task Mining project, and I had several issues:-"New Project with template" it is not working: see attached screenshot-When I create a "New Blank Project", after following the instructions to download and setup the "Task Mining client" using the "Configuration" utility, everything seems to be ok, but the client seems to fail when uploadind data to the server, because I can't see no data non analysis its automatically created. I have checked in my PC that the screenshots and parquet file are created. I have even checked using different PCs as clients, as you can see in the attached "Users and Invite" screenshot. The client without errors seems not to be able to upload data...and even worse, Im not able to see the errors reported by the other client "oscar.vinan".-The celonis snap server seems not to detect the chrome plugin I have installed. Could you so kindly please help or

11
J
Level 1
L
Level 2
lingzhi.lingzLevel 2
asked in Data Ingestion & Infrastructure
System objects in Event collection

Is there any system tables in Celonis we can check, for example, in Oracle, we have all_objects, user_tables such kind of tables we can have an overview understanding for one DB

10
lingzhi.li
Level 2
J
Level 1
james.stronLevel 1
asked in Data Ingestion & Infrastructure
ServiceNow Change Management Data Model

Hello, Is anyone able to share insight into what a ServiceNow Change Management Data Model might look like, i.e. which standard tables are involved and perhaps an example of the associated activity table? What is your experience with using the ServiceNow Change Management Connector and Apps? Appreciate any information or tips, Regards, James

20
J
Level 1
michael.gordo
Level 2
michael.gordoLevel 2
asked in Data Ingestion & Infrastructure
Ariba Invoice Pro

Hi Has anyone created a data model with Ariba Invoice Pro? Ariba Invoice Pro has a separate child realm to Ariba itself If you can help I have two questions Are there any prebuilt connections / apps for Ariba Invoice Pro? Assume this would require 2 data extractions - one for Ariba and one for Ariba Invoice Pro Many thanks Michael

40
J
Level 1
T
Level 2
tomasz.wrobe11Level 2
asked in Data Ingestion & Infrastructure
Apply Permission Table in Data Model using python

Hello, Is it possible to automate with python Apply Permission Table option in data model data permissions.

10
J
Level 1
A
Anonymous
asked in Data Ingestion & Infrastructure
One Data Pool with data from SAP ECC and S4H

Dear All, Could you help me with the following issue? We extracted P2P data from SAP ECC and S4H using ABAP scripts. So I have two sets of exactly same tables related to P2P process. The reason for doing this was, we have different company codes processed in ECC and S4H. Now we we want to upload them using SAP ABAP Output Uploader into one data pool, and finally combine into one data model. Seems like it does not work, because the S4H overwite the previously uploaded ECC data due to the same table name uploaded. thank you in advance Michal

00
J
Level 1
B
Level 2
benedikt.tiege12Level 2
asked in Data Ingestion & Infrastructure
Datamodell Size on Server

Hi, we are trying to guess how much space which Datamodell is consuming on our server. We are running celonis 4.5 on prem on SLES 12. Any recommendations? The primary goal is to determine how much Space we need round about if we want to switch to the IBC. Thanks in advance Benedikt

00
J
Level 1
M
Level 3
masha.galitLevel 3
asked in Data Ingestion & Infrastructure
Text search over all data jobs?

Is there a way to search for a particular text over all data jobs, without entering every single one of them? I want to check if and where a particular database column is used in any of the existing data jobs. Thanks a lot!

00
J
Level 1

Badge Winners

VIEW ALL
Community Code of Conduct