Loading data using Snowflake Copy feature

[gurn]

Hi

I'm using Talend Open Studio 8 and am wanting to use snowflake's COPY command to bulk load my data into snowflake. However, this feature isn't a component in my palette and the tDBBulkExec components do not have Snowflake available as a target database.

So, I'm a bit stuck - has anyone else had a similar issue?

Any thoughts on a resolution would be great.

Thanks

[Anonymous]

I've not tried this, but I would be interested to know whether you can get this to work using tDBRow component and following the Snowflake commands here: https://docs.snowflake.com/en/sql-reference/sql/copy-into-table.html#loading-files-from-an-internal-stage

This is how I would attempt this.

[gurn]

Thanks @Richard Hall​  I was thinking the same, to be honest. Am I right the components designed for COPY would be only those on the subscription service - i.e. tSnowflakeBulkOutput & tSnowflakeBulkExec. They are not available in Open Studio?

[Anonymous]

Yes, I'm afraid that the bulk components are not available in the Open Studio product.

[gurn · Accepted solution]

HI @Richard Hall​ This worked a treat - I have now built a dynamic tDBRow to run the copy statement, so thanks for the advice. Attached is an image of the code if anyone hits the same challenge. All context variables are pulled in earlier via a tDBInput component referencing a meta table in the snowflake database

[Anonymous]

Great work! One of the benefits of Talend is that if it isn't supported "out of the box", you can almost always build a solution in. Thanks for showing your solution. I will set this as the Best Answer!