In order to optimize the data jobs and to increase the speed, I try to select only needed table columns und filter table extraction to only needed data sets.
Unfortunately, this is not easy because it is hard to figure out which columns are needed where.
Therefore, the following proposal:
Implement a Where-Use List.
This should show which tables and columns are used in which filter and in which transformation, e.g.
- a indicator in the Extraction Table Configuration (per table, per column)
- By clicking you can see in which transformations the table or column is used.
where_used986443 22.6 KB
Also, it would be very helpful to see the execution time per task and step in the job log as list column. At the moment I have to open the tasks and steps one by one and calculate the times manually.
execution_time1630511 21.7 KB
Thank you
Thomas