Is there a way to improve performance when doing Pivot ?

Anonymous — Tue, 11 Aug 2015 05:52:30 GMT

Hi,
We are providing 50,000 rows as input to component tPivotToColumnsDelimited and in group by we have 3 columns apart from our pivot column and Aggregation function used is first.
It is taking close to 4 seconds and we are using it multiple times in our job, hence it is creating a major performance bottleneck.

Anybody having any idea on how we can improve performance in this component or any other component that can help in performance improvement or a way that we can do pivot without generation of a csv file as in the case of this component thus helping in improving performance ??

Re: Is there a way to improve performance when doing Pivot ?

Anonymous — Tue, 11 Aug 2015 09:02:35 GMT

Hi,

What's the rate of your current job? Would you mind sharing your job design screenshots with us?
Best regards
Sabrina

topic Is there a way to improve performance when doing Pivot ? in Talend Studio

Is there a way to improve performance when doing Pivot ?

Re: Is there a way to improve performance when doing Pivot ?