topic How to read multiple files with different column names in Talend Studio

How to read multiple files with different column names

Anonymous — Sat, 16 Nov 2024 03:31:49 GMT

Hi,

I'm facing problem in reading multiple files using tFileList. The name of the columns are same for each file but the order in which those column names appear differ from file to file. Due to this the files are not being read and data is not being inserted into the db.

I'm using the format: tFileList----> tFileInputDelimited---->tDBOutput

What schema do I give? I even tried giving the generic schema, but that did not work. And I am giving the right parameters for all the 3 components. Please help me out.

Re: How to read multiple files with different column names

fdenis — Mon, 20 Jan 2020 10:49:33 GMT

use tfileinputrow to get title line then check your order.
but you need to get the hi view of your project.
why did you have multiples format?
is there one format for one way?
it it one shot?
are files manual build?
what is the best way for maintenance and upgrade?
and so on …..
Genseric is useful when when you really need it. but it's harder to work with it.

Re: How to read multiple files with different column names

nivedhitha — Tue, 21 Jan 2020 21:56:37 GMT

@RashmiChandran ,

Take a look at the blog. Might give you an idea

https://www.talend.com/blog/2019/10/31/magically-shuffle-columns-talend-dynamic-schema/