How to process multiple input files with different columns in talend

[Anonymous]

Hi Experts,

I am new to talend and want to understand how to process multiple files in same job with different column names.

For ex:

text1:

account

identity

customer

text2:

acctn

id

cus

I have thousands file like given above and I have to implement same business logic for every file only challenge is column names are different in every file. So please let me know how dynamically we can process these files in talend.

thanks in advance  

[TRF]

Column names don't matter as soon as the number of column and their signification are the same for all the files.

[sbxr]

Hi @abhityagi,

It will be better if you can tell , what exactly you want. Expalin better so that we can help you better.

Regards

[Anonymous]

ok thanks for your reply. Let me give you one example.

I have thousands of file all the files have different names and different column names. I want to apply business logic such as if any column is null then assigned 'Y' value to new variable or assigned 'N'. I don 't want to create again and again schema for any new file or for column names. I want to create a job which can read any file with any column name convention and also create new variable as per their assigned value.

file1:

col:

account

name

gender

file2:

col:

acctn 

cust

sex

Thanks,

Abhishek

[Anonymous]

Hello,

The Dynamic schema feature in talend allows you to design schema with an unknown column structure (unknown name and number of columns).

Please refer to this KB article about:https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/2...

Let us know if it is OK with you.

Best regards

Sabrina