Skip to main content

Hi everyone,

in our Procurement analysis we are evaluating price developments and also compare them with external reference data provided by the German Federal Statistical Office (Destatis). The data is available as CSV flat files, which we currently download and manually integrate into our data model.

I was wondering:
πŸ‘‰ Has anyone already built an automated data ingestion pipeline for this kind of use case (regularly pulling official statistics or external CSV-based sources into Celonis)?
πŸ‘‰ If yes, what approach or tools did you use (APIs, connectors, scheduled pipelines, etc.)?

Any insights or best practices would be highly appreciated!

Thanks in advance πŸ™Œ

Be the first to reply!

Hello there,
Based on best practices, the recommended and proven solution for automating the ingestion of external CSV files, like those from Destatis, into Celonis is to use Action Flows in combination with the Data Push API. This approach allows you to build a scheduled pipeline that automatically fetches the latest CSV data from a source (like an API or file location) and uploads it directly into your Celonis Data Pool. While the Machine Learning Workbench (MLWB) can also be used for more advanced preprocessing, the Action Flow method is favored for its simplicity, low-code interface, and ability to handle direct CSV uploads. This setup ensures your procurement analysis is consistently up to date with the latest external reference data. Let me know if it helps. Many thanks.