columns to rows in talend spark Job

[manodwhb]

Hi,

How we will Convert columns to rows in talend spark Job,since tUnpivot component is not supporting in Talend BigData Batch jobs

Input:-

Id;Name;Sex;Surgery
1;Shong;M;Y
2;Ross;M;Y
3;Elise;F;N

Output:-

Id;Question;Answer
1;Name;Shong
1;Sex;M
1;Surgery;Y
2;Name;Ross
2;Sex;M
2;Surgery;Y
3;Name;Elise
3;Sex;F
3;Surgery;N

[Anonymous]

Hi Manohar,

    Could you please try to run it as a combination of Standard and Bigdata jobs where the standard job will do the unpivoting?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[manodwhb]

Hi Nikhil,

I need to build as a stand alone job? and that too it huge data almost in TB's.

[Anonymous]

Hmm... Can we create some custom code in that case and call from Bigdata batch job as routine?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[TRF]

You can do it within tMap:

[manodwhb]

Hi Nikhil,
Can you share the java code?

[Anonymous]

Hi Manohar,

     Unfortunately I am travelling for next couple of days and may not get time to create the custom code 😞 

     Could you please try @TRF 's suggestion?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[TRF]

@manodwhb, did it work?

Don't forget to give kudos/accept the solution when a replay is helpful (ha ha !)

[manodwhb]

@TRF @nthampi ,With @TRF ,solution it will not work out ,since my target is DB and do not want to generate a file or i do not want to use tExtractDelimitted column.