Skip to main content

Data Ingestion & Infrastructure

Discuss and ask questions about data integration, task mining, admin settings, and PQL extractors to optimize your infrastructure.

  • 810 Topics
  • 2,129 Replies
810 Topics
oliver.joere
Level 3
oliver.joereLevel 3
asked in Data Ingestion & Infrastructure
Archiving of old data

After accumulating 2 years of data in our data O2C and P2P data models, Id like to setup a regular cleanup job to remove all data older than 2 years from the data model. Are there any best practices to do this you could share with me?

30
gabriel.okaba11
Celonaut
steven.bernd
Level 3
steven.berndLevel 3
asked in Data Ingestion & Infrastructure
Formula with two conditions

hello, i need your help with a formula.The following formula does not yet work 100%.COUNT (DISTINCT CASEWHEN /RWEE/PMCP_TAUFK.SLATX LIKE S -% - S% THEN T_CEL_AT_HP5. AUFNR1WHEN MATCH_ACTIVITIES (T_CEL_AT_HP5. TXT30, NODE [Outlook: finished message sent]) = 1 THEN T_CEL_AT_HP5. AUFNR1ELSE NULL END)In my opinion it does not matter in this formula which of the two conditions applies.I would like to have the formula changed so that both conditions must be met.What needs to be changed in the formula?thx

10
K
Level 1
K
Level 3
krzysztof.sitar11Level 3
asked in Data Ingestion & Infrastructure
Filter by eventtime for selected activities

Dear Colleagues,I need to create a date picker component, which would filter the PO items that had any of selected change activities within selected time period (for example monthly).I have created a variable that stores the list of change activties that user select.image382547 12.4 KBI cannot use PU_FIRST(EKPO,Activity_eventtime, Activity_name IN (Variable)) as this returns only the first eventtime of change. I need to select all PO items that had any of selected changes within given period. Can you please help me how to do that?Thank you.

00
K
Level 1
deepak.kumar30
Level 3
deepak.kumar30Level 3
asked in Data Ingestion & Infrastructure
Average of timestamp

Hi,Could you help me to find the average of timestamp like avg(timestamp)?I have job execution end time like below and interested to find the average execution end time:Sun Sep 6 2020 18:30:25Sun Sep 6 2020 8:30:28Sun Sep 6 2020 20:36:25Sun Sep 6 2020 08:00:26Sun Sep 6 2020 05:45:11Sun Sep 6 2020 22:14:01Thanks in advance!Best Wishes,Deepak

40
K
Level 1
.
Level 4
.14600775Level 4
asked in Data Ingestion & Infrastructure
Throughput calculation data discrepancy

Dear Community,I am creating an OLAP table and a throughput time chart in my dashboard. When i compare the 2 results against each other I receive different results. Does anyone understand why this is happening?My OLAP dimension is company code. And KPI is: AVG(CALC_THROUGHPUT(FIRST_OCCURRENCE[Scan] TO LAST_OCCURRENCE[Posting invoice document], REMAP_TIMESTAMPS(ACTIVITIES.EventTime, HOURS)))This gives me a result of 405 hoursMy throughput time chart is:I am using first occurrence of scan and last occurrence of posting invoice document in both scenarios and have selected 1 company code.Does anyone understand what is causing this output difference?Thanks,Anna

10
K
Level 1
N
Level 3
naveen.guptaLevel 3
asked in Data Ingestion & Infrastructure
Data Load Status via mail

HI All, I would like to know if there is any option to have a an automated email sent to the admin on data load status. We would like to have a daily load to start with and would like to get notification weather the load finished successfully or not. Thanks Naveen Gupta

00
K
Level 1
R
Level 1
roberto.gerarLevel 1
asked in Data Ingestion & Infrastructure
SAML nested AD Group is supported?

Hi Celonis Community! While configuring SAML for SSO you can specify the required AD group that contains users that can SSO into Celonis. According to the documentation, on the config-custom.properties file there is a statement to indicate the AD group that SAML will use: saml.users.requiredgroup=MyADGroup Question is could MyADgroup have nested groups?

10
K
Level 1
A
Level 1
ann.powelLevel 1
asked in Data Ingestion & Infrastructure
Single Sign On / Auto Provisioning

We are implementing Celonis and we want to use single sign on via SAML. We set up an Active Directory group for auto provisioning and when we add users to the group, it does not sync with Celonis and create an invitation that is sent to them. Any insight would be great! I am not sure if Celonis or my companys computer security folks need to resolve this. Thanks!

60
K
Level 1
M
Level 1
maxime.maximLevel 1
asked in Data Ingestion & Infrastructure
Transport config from sandbox to productive environnement

Dear All, Im new to the community, so sorry in advance if the question is obvious or not relevant. looking for a tool/feature embedded or not to ease configuration transport from sandbox to productive environment, in order to avoid to break the last operational config in production. regards Maxime

30
K
Level 1
T
Level 3
tyler.safra12Level 3
asked in Data Ingestion & Infrastructure
Authorization Objects in IBC

Fellow Celonauts, Im curious if the Celonis IBC has the same authorization object capabilities as on-prem version 4.5. Ive been scouring the documentation and team settings in Celonis snap, but I dont see any mention of authorization objects or a place to configure the authorization key queries. We have recently undertaken a substantial project to align our on-prem instance of Celonis with our global reporting and analytics security standards using table-based authorization. Were looking to upgrade to the IBC in the next year, but if we cannot migrate the current table-based authorization setup to the IBC this could be a major problem for us. Thanks for any insight! -Tyler

20
K
Level 1
A
Level 2
aashik.sikkaLevel 2
asked in Data Ingestion & Infrastructure
Extract Data Model Load Status logs from Celonis

Hi Team, Is there any way we can extract the data model load status logs from Celonis. Could see some configurations to extract ACCESS_LOGGING and LOGIN_LOGGING from Celonis logs. Looking for similar configuration set up steps to pull the data model load status logs from Celonis Application. Any help on this is highly appreciated. Thanks, Aashik

110
K
Level 1
V
Level 2
vivek.oza12Level 2
asked in Data Ingestion & Infrastructure
Python User Managment , how i can replace the existing usernames with the new username?

Hello Cummunity , Using Python , how i can replace the existing usernames with the new username ? Refering to [1.0.0 / User Management & Permissions] on help celonis de , i extracted Old User Details , and i I already have pandas data frame with Old_User ID , New_User ID , Old_Username ,Old_First Name ,Old_Last Name ,Old_Email , Old User Group , how I can use this dataframe and simply replace old user id with new user id keeping everything else same using Python. How can i do that ?

40
K
Level 1
B
Level 2
benedikt.tiege12Level 2
asked in Data Ingestion & Infrastructure
Monitor last Login-Time from Users

Hi, we need to monitor the last Login-Time per user. Target is to identify Users which hadnt used their account for more than 3 month to disable the accounts. We use our Celonis 4.5 SP2 System based on a Postgres DB but we cant find any metadata about last login. Does anybody know how we could implement that? Thanks for any advice! Benedikt

30
K
Level 1
O
Level 2
olga.olgaLevel 2
asked in Data Ingestion & Infrastructure
Manage Groups Authorization

Dear Community, I want to configure authorization objects for user groups. There is a function for each user - Manage authorizations. image.png1011743 33.1 KB There is no such function for groups. image.png1049727 36.6 KB Could you please tell me how to set up authorization for user groups? Thank you a lot

10
K
Level 1
.
Level 2
.14600772Level 2
asked in Data Ingestion & Infrastructure
Time zone in Celonis

Hello Celonis Team, is it possible to change the time zone in Celonis ? Thanks in advance, Harun

30
K
Level 1
janpeter.van.d
Level 8
janpeter.van.dLevel 8
asked in Data Ingestion & Infrastructure
Change email address of Celonis Community profile

Hi community users and admins, I have a new mail address, but cannot find where to change that in my profile settings. Can somebody help me out? Thank you in advantage! Best, Jan-peter

00
K
Level 1
S
Level 2
sridhar.k14Level 2
asked in Data Ingestion & Infrastructure
SSO / SAML JIT configuration

I want know about SAML JIT configuration . Is there is any document available for the same.

40
K
Level 1
E
Level 3
erwan.bégocLevel 3
asked in Data Ingestion & Infrastructure
Hello,I am trying to find what the syntax error is in this simple line of code:FILTER MATCH_PROCESS_REGEX("_CEL_P2P_ACTIVITIES"."ACTIVITY_EN",'Release Purchase Order' >> (ANY)* >> 'Delete Purchase Order Item')

Error Message states "Syntax error near [FILTER] after reading [] at line 2. Please refer to PQL documentation for available syntax. According to my understanding of the documentation, this should work. Thanks in advance.

100
E
Level 3
A
Level 3
agustín.muñoz12Level 3
asked in Data Ingestion & Infrastructure
How can I calculate next activity of a specific type ?

Hi Celopeers! I am trying to calculate the next activity of a specific type, ignorin all the activities between them. I have tried to filter by those specific activities and then calculate ACTIVITY_LEAD, by it seems that the filter is not working properly for this KPI.   As an example, imagine that the activities what I am talking about are 'A', 'B' and 'C'. But also I have in my process activities '1', '2','3' AND '4'. One casuistic is the following one:   A >> 2 >> 3 >> C >> 4 >> B   The metric I want to calculate is the next activity of the type A,B or C. If I filter the table only by those activities, and include the formula ACTIVITY_LEAD with this filter activated, it still returns me      What I want to have is:    Thank you so much!!

60
A
Level 3
joos.buijs
Level 6
joos.buijsLevel 6
asked in Data Ingestion & Infrastructure
Empty Excel cels break import in CPM46

Hi all, Im prepping some data in Python (pandas data frames) where certain columns dont have a value for each row, e.g. are NULL or NaN for integers and floats. However, when writing the dataframe as Excel file and then loading this into Celonis CPM46 I get the error as below. When writing as CSV I do not get this error on the same data, but the files are far larger and therefore take longer to upload (working from home ) Any idea or tips how to handle this? image865226 13.2 KB

20
joos.buijs
Level 6
A
Anonymous
asked in Data Ingestion & Infrastructure
Combining multiple conditions in a PQL CASE WHEN query

Is there a way to combine conditions across tables in a PQL query or is it required to join tables beforehand in order to be used in a PQL query?   Here is an Examples: I want to go from this: CASEWHEN ISNULL("LIKP"."ZZTERMIN_DATE")=1 AND ISNULL("LIKP"."ZZFRTER")=1 THEN 'Ohne Termine (Ohne frühster & Ohne Fixtermin' WHEN ISNULL("LIKP"."ZZTERMIN_DATE")=0 AND ISNULL("LIKP"."ZZFRTER")=0 THEN 'Mit beiden (Mit frühstem & Fixtermin)'  WHEN ISNULL("LIKP"."ZZTERMIN_DATE")=1 AND ISNULL("LIKP"."ZZFRTER")=0 THEN 'Nur mit frühstem Termin (ohne Fixtermin)' WHEN ISNULL("LIKP"."ZZTERMIN_DATE")=0 AND ISNULL("LIKP"."ZZFRTER")=1 THEN 'Nur mit Fixtermin (ohne frühster Termin)' END  To this:CASE WHEN "LIPS.LFIMG" <> '0' AND ISNULL("LIKP"."ZZTERMIN_DATE")=1 AND ISNUL

00
K
Level 1
joos.buijs
Level 6
joos.buijsLevel 6
asked in Data Ingestion & Infrastructure
Number of open tasks over time

Hi all,I would like to build a chart which shows the number of open activities at a given day.In our data activities are a combination of a task (e.g. modelling or testing), and a (lifecycle) status (e.g. new, in progress, done, rejected). I would like to plot per day the number of open tasks/activities of a certain type.I currently have the activity timestamp aggregated to day as DIMENSION, and the following KPI:MOVING_COUNT_DISTINCT(CASE WHENMATCH_ACTIVITIES(NODE[Testing - In progress] , EXCLUDING[Testing - Done, Testing - Rejected] ) = 1THEN L33_V_MBD_INZICHTEN_STATUS.FEATUREAPGIDELSE NULLEND,-999,0)In (my?) theory this should use the activities up until the day, and then determine whether the case contains an open testing task or not. However, my current result is incorrect:image1223594 18.2 KBWhich trick am I missing?BTW: were on CPM4.6Happy holidays!

20
K
Level 1
P
Level 3
prakash.k14Level 3
asked in Data Ingestion & Infrastructure
Pivot table removing unwanted values

Hi Team,Am trying to find out , country wise how many billing blocked customers and delivery blocked customers I think i did it, but how do i remove the zeros from the pivot table.image940425 14.6 KBIf i expand the country, i required only the KPIs Dimension. not the unwanted values (refer the below screen shot). Thanks in advance.image977439 28 KB

00
P
Level 3
I
Level 2
isaac.tarum11Level 2
asked in Data Ingestion & Infrastructure
Plant Maintenance link to Purchase Order

Does anyone have the link between the Plant Maintenance Orders PMOs tables to Purchase Order POs table EKPO?

00
gabriel.okaba11
Celonaut
K
Level 2
kenneth.mcgra12Level 2
asked in Data Ingestion & Infrastructure
Trying to calculate difference in stock value between dates

HI, as a newbie to PQL, I am would need help in order to calculate the different in stock levels between two months. The current display shows the SUM of the stock, with a Component Filter the particular month. How could I calculate the difference between the starting stock (January) and the current stock level, by month? (there are multiple stock items)ThanksKenny7

00
gabriel.okaba11
Celonaut

Badge Winners

VIEW ALL
Community Code of Conduct