Unite two datasets Automatically by name

Anonymous — Mon, 11 Mar 2019 12:43:23 GMT

Hello all,

In Talend we use a tool called Tunite to union two or more data-sets. The problem with it is the schema of all the data-sets should be same, where the order of the columns and the number of columns should always be same. When handling a larger data-set, ordering the data-sets or creating dummy columns becomes difficult as there are many number of columns and many data-sets.

Is there any way where i can just unite them automatically based on the column names? and if the column is missing in other data-set it should have nulls instead.

If it i a custom component , can anyone guide me towards the existing component or help me build one.

Thanks & Regards,

Ross Nox

Re: Unite two datasets Automatically by name

akumar2301 — Mon, 11 Mar 2019 15:19:25 GMT

You can easy do using tMap and tFileOutputdelimited in Append Mode or tHashxxxx

Try to use , tMap , AutoMap Button , it does auto mapping for the columns where input and output is matching , otherwise make as NULL.

for example , here below , In output I have four columns , but input only two , I simply click on AutoMap and it map only columns having same Name and Others as NULL.

Now at Output side , you can add tFileOutputdelimited in Append Mode.

Hope this will help.

topic Unite two datasets Automatically by name in Talend Studio

Unite two datasets Automatically by name

Re: Unite two datasets Automatically by name