topic Re: Problem performances with tPivotToColumnsDelimited in Talend Studio

Problem performances with tPivotToColumnsDelimited

Anonymous — Thu, 10 Nov 2016 08:40:27 GMT

Hi,
Talend 6.2, os linux
I'm trying to make a pivot with data from an input postgresql connector to a tPivotToColumnsDelimited without any transformation.
there's 1 013 654 rows with 20 columns and it makes a pivot with a column that contains YYYY-MM.
yesterday, i've run it at 14:40 and let it done the afternoon and i think a part of the night.
I think because i'm connected to the server with a remote connection and i've been disconnected.
The result is nothing. The file is empty and i don't understand and i don't know where i can see any log/report of the problem.
We have already increase java memory to 8Go.

Anyone have an idea to :
[list=*]

make the treatment works,

see where is the problem

Re: Problem performances with tPivotToColumnsDelimited

Anonymous — Fri, 11 Nov 2016 03:25:59 GMT

Hi,
Does this performance only repro on your pivot job? Could you please post your job setting screenshot into forum which will be helpful for us to address your issue?
Best regards
Sabrina

Re: Problem performances with tPivotToColumnsDelimited

vapukov — Fri, 11 Nov 2016 04:22:07 GMT

First of all You can include (enable) for You job logging and point logs to knowing folder
After this at least will be clean where the problem

Re: Problem performances with tPivotToColumnsDelimited

Anonymous — Tue, 15 Nov 2016 09:01:10 GMT

Hello,
sorry for the delay.

My job is very simple as you can see.
I'v increased the server java parameter -Xmx to 6Go