topic Re: tsetDynamicSchema - source data changes in Talend Studio

tsetDynamicSchema - source data changes

Anonymous — Fri, 10 Mar 2017 04:32:29 GMT

I have a use case of reading data from the csv files coming in. But at times few columns are not in order or missing. But target is not changing in Database. In such scenarios how can i use tsetDynamicSchema to handle? if i can not use tsetDynamicschema, what is the other best component.

Regards
Velu.

Re: tsetDynamicSchema - source data changes

Anonymous — Mon, 13 Mar 2017 03:29:12 GMT

Hi velu,

But at times few columns are not in order or missing. But target is not changing in Database.

[font=Verdana, Helvetica, Arial, sans-serif] Have you tried to use talend "Dynamic Schema" feature? Which [/font] allows you to design schema with an unknown column structure (unknown name and number of columns).
Best regards
Sabrina

Re: tsetDynamicSchema - source data changes

Anonymous — Mon, 13 Mar 2017 07:35:06 GMT

No, Any link to help me in understanding / guiding to define the undefined column and data types between source and target?

Re: tsetDynamicSchema - source data changes

Anonymous — Mon, 13 Mar 2017 08:30:26 GMT

Hi,
Here is a KB article about:TalendHelpCenter:How to process changing data structure?
Let us know if it is Ok with you.
Best regards
Sabrina

Re: tsetDynamicSchema - source data changes

vapukov — Mon, 13 Mar 2017 09:01:24 GMT

Dynamic schema present in subscription version of Talend
it work with few restrictions:
[list=*]

number of source columns must be same or less than target

name of source and target columns must be the same

order could be different

so, for example if You have in csv file - 1 additional column, or 1 column with different name, the Job will finishing with error
if You have just different order - it will be work

alternative for OpenSource version - tFileInputTextFlat, the great component from Jan Lolling
If You know all target columns - You can extract them without worry - if they present in file or not, and omit all other columns