Skip to main content
Announcements
SYSTEM MAINTENANCE: Thurs., Sept. 19, 1 AM ET, Platform will be unavailable for approx. 60 minutes.
cancel
Showing results for 
Search instead for 
Did you mean: 
rkaruppiah
Contributor
Contributor

[resolved] how to Merge Rows from delimited files having different Schemas

Hi,
I want to merge rows/records from multiple (say around 15 files) pipe delimited files having different schemas. I know tUnite does the merging of rows from various sources. I want to know is there any other talend (or customized components) components available and being used effectively for merging rows or tUnite is the only component? And do we have any other approaches for merging the rows from multiple delimited files having different schemas?
Thanks!!!!

Labels (2)
1 Solution

Accepted Solutions
Anonymous
Not applicable

All you need is tUnite and tMaps to do this. For every file that is imported, create a tMap for it with a schema that is suitable for all files. So, for example, if you have 4 files with the following schemas....

File1
a
b
c
d

File2
a
c
e
g

File3
b
c
f
h

File4
e
f
i
j

..... your output schema for all tMaps used will be...

a
b
c
d
e
f
g
h
i

You can then use the tUnite without issue.

View solution in original post

2 Replies
Anonymous
Not applicable

All you need is tUnite and tMaps to do this. For every file that is imported, create a tMap for it with a schema that is suitable for all files. So, for example, if you have 4 files with the following schemas....

File1
a
b
c
d

File2
a
c
e
g

File3
b
c
f
h

File4
e
f
i
j

..... your output schema for all tMaps used will be...

a
b
c
d
e
f
g
h
i

You can then use the tUnite without issue.
rkaruppiah
Contributor
Contributor
Author

Thanks for the step by step solution. It helped. Thank you Smiley Happy