Remove Particular Column from Dynamic Schema and load it into snowflake

[Anonymous]

Hi All,

I have one scenario. I have to load data dynamically(with dynamic datatypes) from a delimited file to snowflake database. But while loading I have to remove particular column from file.

Ex- Source Column

Id,Name,Age,Address

Target Column Should be

Name,Age,Address

Thanks in Advance..!!

[Anonymous]

Hi,

    The most easy way will be to first write the data to a temp table without ID column and then do lift and shift to target table based on your rule.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[Anonymous]

@nthampi yes this is correct

After loading from file to db
Write a query select Name, Age, Address from Source table | Target table (use insert)

Use one context file, write query in it like above along  with target table with any separator

query | table

you can also use to load multiple tables from file

file => tflowiterate => tdbinput => tdboutput

Thanks

Manish

[Anonymous]

Hi Nikhil,

Actually i have a generic job which is loading multiple tables from different csv files and while loading i am using dynamic schema option but i dont want first column to be inserted in target table . I dont have option to load this file into stage table and then load it into target while not selecting that particular column. Is there any option in talend to remove first column while using dynamic schema in tfileinputdelimited component.

[Anonymous]

@Sonalk2 

You will have to write custom java code using Talend routines in your case as you are trying to create a Dynamic column and at the same time trying to trim the data.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved