Skip to main content

Data Ingestion & Infrastructure

Discuss and ask questions about data integration, task mining, admin settings, and PQL extractors to optimize your infrastructure.

  • 809 Topics
  • 2,126 Replies
809 Topics
M
Level 2
mark.limudLevel 2
posted in Data Ingestion & Infrastructure
Hello Peers,

Hello Peers, do you know if there is a way or workaround to enforce an update of the upper threshold in a Single-KPI component when a filter is applied on the dashboard. Currently, the upper threshold if calculated on all data once but it does not react on a filtering. w/o filtering:w/ filtering:Hope, you guys have an idea on that matter ;-) Cheers,Mark

02
M
Level 2
M
Level 3
matthew.wittyLevel 3
asked in Data Ingestion & Infrastructure
Warning Message on Data Model Loads re: Too Many Rows

"The table [insert table name] has more than 30000000 rows and it is therefore not recommend to be used with the augmentation feature." I see this warning message for a number of our tables, but that is expected. There is a substantial amount of data in these tables. Is there a way to either deactivate this message or remove it entirely? It seems unnecessary in the event a table is naturally designed to be that large, like CDPOS/CDHDR or even VBAK.

10
G
Level 2
.
Level 3
.146004148Level 3
asked in Data Ingestion & Infrastructure
How many prebuilt connectors does Celonis have?

Hi process miners,  I'm doing some pitchdeck/marketing work and I'm wondering how many prebuilt connectors Celonis has. Based on this page, there is 20 https://docs.celonis.com/en/data-connections.html, but UiPath process mining has over 50. I can't imagine UiPath has more than Celonis,. Does anyone have a total number of prebuilt connectors?

20
.
Level 3
M
Level 3
michaō.rogosLevel 3
asked in Data Ingestion & Infrastructure
How to calculate the cycle time between specific variants of process activities?

Hi,​ I would highly appreciate your help as building given KPIs is business critical for our customer. Many thanks in advance,Michał  The issue is as follows: Client required a KPIs of total time of approvals and number of invoices going through approval within wider AP process. There may be different variants. Case 1 - The CT is simply time between A1 and A8, timestamp of activity A3 (in between) does not affect the calculationA1/ Invoice submitted for Approval A3/ Change PriceA8/ Invoice Approved  Case 2 – in that case, the calculation should start with A1 and stop once invoice rejected (activity A2) and then restored from next submission (activity A5) until approved (activity A8). Time between A2 and A5 should not be included/ any activities in between should not be taken into account. So the CT here is A1 to A2 plus A5 to A8. A1/ Invoice submitted for Approval A2/ Invoice RejectedA3/ Change PriceA5/ Invoice submitted for Approval A8/ Invoice Approved   Case 3 – in that case, the c

200
D
Level 1
S
Level 5
sasa.redze12Level 5
asked in Data Ingestion & Infrastructure
How to setup Time Filters correctly during Table Extraction?

Are these 2 Time Filters equivalent or should the Time Filter be preferred over the Filter Statement? If so why?

00
D
Level 1
S
Level 3
siddhesh.naik11Level 3
posted in Data Ingestion & Infrastructure
Is there a standard technical specification document format available with Celonis for Extraction and Analyses technical documentation?

Is there a standard technical specification document format available with Celonis for Extraction and Analyses technical documentation?

01
G
Level 8
biswajit.jena12
Level 3
biswajit.jena12Level 3
posted in Data Ingestion & Infrastructure
What is the go-live date for the new file uploader in EMS? It was supposed to be 16th Sep, but still dont see it in EMS.

What is the go-live date for the new file uploader in EMS? It was supposed to be 16th Sep, but still dont see it in EMS.

00
biswajit.jena12
Level 3
florian.mrkvi
Level 4
florian.mrkviLevel 4
posted in Data Ingestion & Infrastructure
Can I get values from a referenced case?

Can I get values from a referenced case? Hi, in my datamodel the cases are customer's orders. An order can get paused due to other order of the same customer. In this case the first order also has the CaseID of the blocking order as a reference in the CASE table. Now I want to show each CaseID in a column and a value from the referenced Case in a seperate column.  I.e. I want to say something like:"Give me the value "CASE"."ORDER_TYPE" of the case whose CASE_ID is referenced in THIS case's column "CASE"."BLOCKED_BY". All attempts with Pull-Up and Domain_Table statements failed.Any ideas? BR Florian

15
G
Level 8
C
Level 3
chakradhar.pokalLevel 3
asked in Data Ingestion & Infrastructure
celonis data extraction from source system is pull based or push based ?

celonis data extraction from source system is pull based or push based ?

00
C
Level 3
C
Level 3
chakradhar.pokalLevel 3
asked in Data Ingestion & Infrastructure
During Step 4: Does this step generate a flat file or is all data held in memory?I think It will not generate flat file. Just data will be stored on private cloud. Please suggest me with correct answer.

During Step 4: Does this step generate a flat file or is all data held in memory?

20
C
Level 3
dennis.arrin
Level 3
dennis.arrinLevel 3
asked in Data Ingestion & Infrastructure
Filtering a date range around a specific activity per case

Hi guys! I’m trying to apply a particular filter to a dataset with many activities. The scenario is as follows. The raw event log contains activities done in a general hospital for over a year.If I want to get the process for a specific activity, I would normally just filter ‘Include only cases that contain ‘Knee Replacement Surgery’.  However, because there is so much going on in the hospital, such a filter is not enough. For example, if a person underwent a knee surgery is june 2021, the process map will also try to include other procedures that this person did in january 2021 or december 2021, even though these have nothing to do with the knee replacement surgery. For that reason, I’m trying to narrow the filter down as follows: “Provide an event log that only includes data of a maximum of 2 weeks in the past after the activity ‘Knee replacement surgery’ and a maximum of 2 weeks after this same activity.” Note that this is NOT the same as applying a general time filter on the event

90
dennis.arrin
Level 3
R
Level 4
raman.silot14Level 4
asked in Data Ingestion & Infrastructure
data limit of celonis ems

I am curious how much data can we extract and store in celonis ems for both free training use and production use?

30
A
Level 1
tushar.konde
Level 3
tushar.kondeLevel 3
posted in Data Ingestion & Infrastructure
dell.us-1.celonis.cloud

---------------------------------------------------------------------------HTTPError Traceback (most recent call last)~/.local/lib/python3.8/site-packages/pycelonis/celonis_api/base_objects/ibc.py in api_request(self, url, message, method, timeout, get_json, threaded, **extra) 273 try:--> 274 r.raise_for_status() 275 except exceptions.HTTPError as e: /opt/conda/lib/python3.8/site-packages/requests/models.py in raise_for_status(self) 952 if http_error_msg:--> 953 raise HTTPError(http_error_msg, response=self) 954  HTTPError: 404 Client Error: Not Found for url: https://dell.us-1.celonis.cloud/process-mining/analysis/v1.2/api/analysis/325c3e97-3a13-4c7a-b818-ac392eebd840/bookmarks/809dfc8f-86c4-4210-9818-a4b2734543c6 During handling of the above exception, another exception occurred: HTTPError Traceback (most recent call last)/tmp/ipykernel_16778/3654934662.py

195
G
Level 8
steven.bernd
Level 3
steven.berndLevel 3
asked in Data Ingestion & Infrastructure
KPI in component Filter

Hello, everyone, I would like to add my KPI "SUM(CASE WHEN (LEFT("COEP"."KSTAR", 1) IN ('6','9')) THEN "COEP"."WTGBTR" ELSE NULL END)" to the component filter to hide the 0 values. What do I have to pay attention to here, because FILTER SUM(CASE WHEN (LEFT("COEP"."KSTAR", 1) IN ('6','9')) THEN "COEP".."WTGBTR" ELSE NULL END) != 0 does not work. Greetings

40
G
Level 8
irfan.suria12
Level 4
irfan.suria12Level 4
posted in Data Ingestion & Infrastructure
WINDOW_AVG (or alternatives)

WINDOW_AVG (or alternatives) Hi all, I calculate the average cycle time from PO Item creation to Record Goods Receipt per material with the following query: PU_AVG ( DOMAIN_TABLE ( "EKPO"."MATNR" ) , DAYS_BETWEEN ( PU_FIRST ( "EKPO" , "_CEL_P2P_ACTIVITIES"."EVENTTIME" , "_CEL_P2P_ACTIVITIES"."ACTIVITY_EN" = 'Create Purchase Order Item' ) , PU_FIRST ( "EKPO" , "_CEL_P2P_ACTIVITIES"."EVENTTIME" , "_CEL_P2P_ACTIVITIES"."ACTIVITY_EN" = 'Record Goods Receipt' ) )) Now, I want to consider only the latest 10 PO items into the calculation based on the creation date. How can I do that? I tried the WINDOW_AVG function, but it does not work: WINDOW_AVG( <above query>, 0, 10, ORDER BY (PU_FIRST ( "EKPO" , "_CEL_P2P_ACTIVITIES"."EVENTTIME" , "_CEL_P2P_ACTIVITIES"."ACTIVITY_EN" = 'Create Purchase Order Ite

72
irfan.suria12
Level 4
V
Level 4
vivek.mLevel 4
posted in Data Ingestion & Infrastructure
Hello PQL experts,

Hello PQL experts, Am looking for SAP Order Confirmation related KPIs ?  Eg : Number of Orders Vs Durations ( Days) .Any inputs is appreciated in Advance ! Br.Vivek

14
V
Level 4
.
Level 3
.146012012Level 3
asked in Data Ingestion & Infrastructure
PQL question;I am trying to create a query that counts activities after a specific activity is captured.

PQL question; I am trying to create a query that counts activities after a specific activity is captured.

30
irfan.suria12
Level 4
S
Level 3
siddhesh.naik11Level 3
asked in Data Ingestion & Infrastructure
Enabling Primary Key

Based on understanding of Vertica SQL/Postgre SQL, following piece of script I am implementing to enable primary key. But even after successful, error free execution of these statements, I can see Celonis allows INSERT with same values. Can you help me in understanding if I am falling short on something to enable primary key? CREATE TABLE _CEL_ACTIVITY_PRIMARY_TEST(    _case   varchar(25),    activity_name varchar(100) not null,    eventime DATETIME not null,    PRIMARY KEY(_case)); SELECT * FROM _CEL_ACTIVITY_PRIMARY_TEST; INSERT INTO _CEL_ACTIVITY_PRIMARY_TEST VALUES ('1234','act1','2022-08-22T09:46:46');

10
S
Level 3
N
Level 2
niyi.ogunb12Level 2
asked in Data Ingestion & Infrastructure
File upload error

I get the following error message when I attempt to upload a flat file (csv/excel): "There was an error during file upload. Please check your file type and content". Any suggestion how to fix this?

00
D
Level 1
.
Level 2
.14600957Level 2
asked in Data Ingestion & Infrastructure
Connecting Celonis4.7.2 to GCP BigQuery using Simba JDBC Driver

We are trying to connect Celonis4.7.2 (onprem) to the GCP using the BigQuery Simba JDBC Driver supplied by Google. The .jar files have been unzipped into <installDir>\\lib but trying to connect from the frontend, we encounter the following errormessage: Has anyone successfully connected Celonis4.7 (or any other onprem version) to the GCP?  Thank you for your help! Cheers, Felix

10
V
Celonaut
M
Level 2
marcia.cristina.silvaLevel 2
asked in Data Ingestion & Infrastructure
Hi! I'm working with Celonis task mining, capturing data with filter by applications and URL, I have two different users, one can capture the URL and the other cannot. What could be the problem? Would it be firewall?

Hi! I'm working with Celonis task mining, capturing data with filter by applications and URL, I have two different users, one can capture the URL and the other cannot. What could be the problem? Would it be firewall?

10
R
Level 3
R
Level 4
raman.silot14Level 4
asked in Data Ingestion & Infrastructure
Data Model VS Joins

For example, in P2P data model we connect EKPO and EKKO using foreign key relationship, but then also we mention that in data jobs while creating EKKO. So my question is why we are doing the double work here? Also what is going to happen if I do not connect two tables that are required to be connected in the data model ?

10
T
Level 1
steven.bernd
Level 3
steven.berndLevel 3
asked in Data Ingestion & Infrastructure
Count days between activities, but with condition

Hello, I need your swarm knowledge. I need a combination of the following formulas.... TRIMMED_MEAN(CALC_THROUGHPUT(FIRST_OCCURRENCE[<%=Process_Start_1%>] TO LAST_OCCURRENCE[<%=Process_Start%>], REMAP_TIMESTAMPS("T_CEL_AT_HP5"."EVENTTIME", DAYS, MONDAY TUESDAY WEDNESDAY THURSDAY FRIDAY)), 5, 5) ...if the condition beforehand... "/RWEE/PMCP_TAUFK"."ARBPL_AN" LIKE 'S-%-S%' ...grips. Hope for help :-) thx

00
steven.bernd
Level 3
M
Level 2
menno.van.e12Level 2
asked in Data Ingestion & Infrastructure
Extract BPMN model including additional attributes

Hi,  I would like to extract a BPMN model from my Event Log but want to include additional attributes (like user role that is related to the activity, application in which the specific activity takes place, etc.) in order to generate a complete model of the process.  Is this possible, or can you only extract a simple BPMN model with the activities and connections?  Thanks in advance!

140
B
Celonaut
D
Level 2
daniel.nLevel 2
asked in Data Ingestion & Infrastructure
How do I efficiently reduce the size of my data model?

Hi there,I am looking for an efficient way to reduce the size of my data model: I already reduced the time period of the ingested data. As a second step I want to get rid of some unused table columns. To identify unused table columns I thought about doing the following:Export a .txt documentation of each analysis, then search for a specific table (ctrl+f) (i.e. LIPS) and document which columns are really in use in this analysis. I do this with all analyses and then I know which columns I can exclude in the extractions because they are not used anywhere.  It's not as much manual work as it sounds but still a lot. Do you know a better way to do this? How do you avoid such work in the future? Is there a standard procedure how to handle this problem or not run into it in the first place?  Thanks for your helpDaniel  

40
janpeter.van.d
Level 8

Badge Winners

  • Value Assessment Expert
    gabriela.cruzhas earned the badge Value Assessment Expert
  • Qualified to Identify and Drive Opportunities
    gabriela.cruzhas earned the badge Qualified to Identify and Drive Opportunities
  • First Post
    joaocarlos.maciehas earned the badge First Post
  • First Post
    asdfghas earned the badge First Post
  • Celonis Technical Expert
    Clarahas earned the badge Celonis Technical Expert
VIEW ALL
Community Code of Conduct