topic Re: [resolved] how to Merge Rows from delimited files having different Schemas in Talend Studio

[resolved] how to Merge Rows from delimited files having different Schemas

rkaruppiah — Thu, 02 Jul 2015 17:44:16 GMT

Hi,
I want to merge rows/records from multiple (say around 15 files) pipe delimited files having different schemas. I know tUnite does the merging of rows from various sources. I want to know is there any other talend (or customized components) components available and being used effectively for merging rows or tUnite is the only component? And do we have any other approaches for merging the rows from multiple delimited files having different schemas?
Thanks!!!!

Re: [resolved] how to Merge Rows from delimited files having different Schemas

Anonymous — Thu, 02 Jul 2015 21:10:03 GMT

All you need is tUnite and tMaps to do this. For every file that is imported, create a tMap for it with a schema that is suitable for all files. So, for example, if you have 4 files with the following schemas....

File1
a
b
c
d

File2
a
c
e
g

File3
b
c
f
h

File4
e
f
i
j

..... your output schema for all tMaps used will be...

a
b
c
d
e
f
g
h
i

You can then use the tUnite without issue.

Re: [resolved] how to Merge Rows from delimited files having different Schemas

rkaruppiah — Mon, 06 Jul 2015 20:22:50 GMT

Thanks for the step by step solution. It helped. Thank you