Skip to main content
Solved

extract large object data types from oracle to celonis ems with jdbc extractor

  • December 20, 2022
  • 11 replies
  • 14 views

markus.weih12
Level 3
Forum|alt.badge.img+10

Hi all,

is it possible to extract large object data types from oracle to celonis ems with jdbc extractor? 

Thanks,

Markus

Best answer by david.stefa13

The new versions of the JDBC extractor now support Oracle CLOBS.

 

->August 2023 Release Notes - Oracle CLOB and NCLOB support

This version of the JDBC Extractor adds support for Oracle CLOB (Character Large Object) and NCLOB (National Character Large Object) data types. Your Java version must be at least Java 17 for this version of the JDBC Extractor. 

 

https://docs.celonis.com/en/august-2023-release-notes.html#UUID-4daf39d6-3a16-5e58-549c-ada391c71d43_section-idm458455136201443384259775927

 

 

11 replies

teuku.faruq13
Level 9
Forum|alt.badge.img+1

Dear @markus.weih12 ,

 

You may want to check https://www.vertica.com/docs/12.0.x/HTML/Content/Authoring/SQLReferenceManual/DataTypes/OracleVerticaDataTypeMappings.htm?. You also may perform pre-process to ensure compatibility before extracting into Celonis.

 

Let me know your thoughts.

 

 


markus.weih12
Level 3
Forum|alt.badge.img+10
  • Author
  • Level 3
  • December 20, 2022

Thanks for your reply!

What does you mean with pre-processing?

 


teuku.faruq13
Level 9
Forum|alt.badge.img+1

Instead of perform conversion during Celonis extraction, perform all necessary clean up at source by creating another view or something similar and then extract into Celonis. This will make your script leaner / less to maintain.


markus.weih12
Level 3
Forum|alt.badge.img+10
  • Author
  • Level 3
  • December 20, 2022

Thanks. Is there any alternative option to convert during extraction on celonis side? In our setting it is not easily possible to change or add anything in source system.


teuku.faruq13
Level 9
Forum|alt.badge.img+1

Markus, sure you can do it during task creation under extraction job. At the task config, under General > Column Configuration then you may select the data type.

 

If extraction didnt provide the right setting and maybe try it as string / text first and later create another staging with the right conversion once data in celonis. Let me know and hopefully it works.


markus.weih12
Level 3
Forum|alt.badge.img+10
  • Author
  • Level 3
  • December 20, 2022

Unfortunately we receive only IDs like oracle.sql.CLOB@xxxxxxx within Celonis. So I think we have only the opportunity to create a view or something similar in source system and then extract into Celonis.


teuku.faruq14
Level 4
Forum|alt.badge.img+1

Source is better, stage it in Azure or other cloud also works it depend on overall architecture. It is interesting question, unfortunately I dont have Oracle db for me to setup quick trial to test some idea. Sorry for not being helpful.


teuku.faruq13
Level 9
Forum|alt.badge.img+1

Btw @Guillermo Gost  mention interesting area which is PyCelonis. Perhaps another area to explore to process it through ML workbench https://celonis.github.io/pycelonis/2.0.0/tutorials/executed/02_data_integration/02_data_push/. In short you may create your predefine table and then get data using panda + perform conversion and then push to table.


markus.weih12
Level 3
Forum|alt.badge.img+10
  • Author
  • Level 3
  • December 20, 2022

@Teuku Faruq thanks for your ideas!


david.stefa13
Level 5
Forum|alt.badge.img+15
  • Level 5
  • Answer
  • October 30, 2023

The new versions of the JDBC extractor now support Oracle CLOBS.

 

->August 2023 Release Notes - Oracle CLOB and NCLOB support

This version of the JDBC Extractor adds support for Oracle CLOB (Character Large Object) and NCLOB (National Character Large Object) data types. Your Java version must be at least Java 17 for this version of the JDBC Extractor. 

 

https://docs.celonis.com/en/august-2023-release-notes.html#UUID-4daf39d6-3a16-5e58-549c-ada391c71d43_section-idm458455136201443384259775927

 

 


markus.weih12
Level 3
Forum|alt.badge.img+10
  • Author
  • Level 3
  • October 31, 2023

Thanks @david.stefa13 - that is very cool and helps us!