Skip to main content
Solved

Problems with Parquet files and data types (Datetime)

  • May 5, 2023
  • 2 replies
  • 34 views
C
Level 1
Forum|alt.badge.img+6

Working with a dataframe activity table in Python I export the file in parquet format for efficiency reasons. However, when I load the file in Celonis it doesn't recognise the timestamp in the proper format but as a string. Can anyone tell me why this error is happening?

 

Thank you very much.

 

Thanks a lot.

Best answer by badrinath.nooka13

You need to use engine, use_deprecated_int96_timestamps. in convertion to parquet file for celonis to recognize the timestamps.

 

Example:

df.to_parquet('data.parquet',index = None,engine='pyarrow',use_deprecated_int96_timestamps=True)

 

Hope this solves your issue

    2 replies

    badrinath.nooka13
    Level 3
    Forum|alt.badge.img+14

    You need to use engine, use_deprecated_int96_timestamps. in convertion to parquet file for celonis to recognize the timestamps.

     

    Example:

    df.to_parquet('data.parquet',index = None,engine='pyarrow',use_deprecated_int96_timestamps=True)

     

    Hope this solves your issue

    C
    Level 1
    Forum|alt.badge.img+6

    Problem solved. Thank you very much.

     

    Thanks a lot. 😄 ✌️

    Community Code of ConductAccessibility statement