topic Re: Headers missing on combining tFileOutputDelimited outputs in a single file in Talend Studio

Headers missing on combining tFileOutputDelimited outputs in a single file

Anonymous — Sat, 16 Nov 2024 02:08:08 GMT

I created a workflow : tDBInput -> tMap -> tFileOutputDelimited. As tMap produces 5 different outputs, i have 5 tFileOutputDelimited connections created out of it and then updated config to update in single file. While doing that, i checked Append and Include Header checkbox. PFA screenshot. Generated file has header for 1st output only but subsequent headers are missing from the file. Also, observed that appending does not happen sequentially. It mixes up the output data in random manner. Any help on this issue is appreciated.

Re: Headers missing on combining tFileOutputDelimited outputs in a single file

manodwhb — Wed, 17 Jun 2020 07:34:18 GMT

@Moe ,can you show your job design?

Re: Headers missing on combining tFileOutputDelimited outputs in a single file

Anonymous — Wed, 17 Jun 2020 07:42:05 GMT

@manodwhb Sure. please find attached img.

img2.jpg

Re: Headers missing on combining tFileOutputDelimited outputs in a single file

David_Beaty — Wed, 17 Jun 2020 08:06:22 GMT

Hi,

I'm not sure pushing 5 different outputs to the same file is a sensible idea? Consider pushing just 1 to the file directly, and the other 4 to 4 tHashOutput components, then read each of the 4 back in, and push to the file one at a time.

As an alternative, not sure if this will work, on the Advanced tab for each tFileOutputDelimited, tick the "Output in row mode" option.

Re: Headers missing on combining tFileOutputDelimited outputs in a single file

Anonymous — Wed, 17 Jun 2020 10:50:51 GMT

Thanks @dsoulalioux for response. I tried with "Output in row mode" option in Advanced settings. it did not work.

Re: Headers missing on combining tFileOutputDelimited outputs in a single file

David_Beaty — Wed, 17 Jun 2020 11:16:13 GMT

That was just a long shot.

Separating the flows out and then feeding them into the final file, one feed at a time is probably the only option.

Re: Headers missing on combining tFileOutputDelimited outputs in a single file

Anonymous — Wed, 17 Jun 2020 13:05:56 GMT

Talend does not allow this kind of operation.