topic Re: Remove Particular Column from Dynamic Schema and load it into snowflake in Talend Studio

Remove Particular Column from Dynamic Schema and load it into snowflake

Anonymous — Mon, 07 Oct 2019 17:56:14 GMT

Hi All,

I have one scenario. I have to load data dynamically(with dynamic datatypes) from a delimited file to snowflake database. But while loading I have to remove particular column from file.

Ex- Source Column

Id,Name,Age,Address

Target Column Should be

Name,Age,Address

Thanks in Advance..!!

Re: Remove Particular Column from Dynamic Schema and load it into snowflake

Anonymous — Mon, 07 Oct 2019 20:52:58 GMT

Hi,

The most easy way will be to first write the data to a temp table without ID column and then do lift and shift to target table based on your rule.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: Remove Particular Column from Dynamic Schema and load it into snowflake

Anonymous — Tue, 08 Oct 2019 02:06:04 GMT

@nthampi yes this is correct

After loading from file to db
Write a query select Name, Age, Address from Source table | Target table (use insert)

Use one context file, write query in it like above along with target table with any separator

query | table

you can also use to load multiple tables from file

file => tflowiterate => tdbinput => tdboutput

Thanks

Manish

Re: Remove Particular Column from Dynamic Schema and load it into snowflake

Anonymous — Tue, 08 Oct 2019 13:51:51 GMT

Hi Nikhil,

Actually i have a generic job which is loading multiple tables from different csv files and while loading i am using dynamic schema option but i dont want first column to be inserted in target table . I dont have option to load this file into stage table and then load it into target while not selecting that particular column. Is there any option in talend to remove first column while using dynamic schema in tfileinputdelimited component.

Re: Remove Particular Column from Dynamic Schema and load it into snowflake

Anonymous — Thu, 10 Oct 2019 23:05:24 GMT

@Sonalk2

You will have to write custom java code using Talend routines in your case as you are trying to create a Dynamic column and at the same time trying to trim the data.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved