topic Unloading from Snowflake to AWS S3 using Talend in Talend Studio

Unloading from Snowflake to AWS S3 using Talend

vvazza10 — Sat, 16 Nov 2024 01:33:17 GMT

Hello guys ! I am trying to unload data from a Snowflake table and load to AWS S3 external stage using COPY command. I tried using tDBInput component and entered the COPY command onto Full SQL query string field. But the value seem to be NULL while running the job - tDBInput_1 null

Please advise how we can unload data from Snowflake table and load to AWS S3 external stage.

Re: Unloading from Snowflake to AWS S3 using Talend

Anonymous — Wed, 02 Sep 2020 03:30:49 GMT

Hello,

Are you able to read data from a Snowflake table into the data flow of your Job based on your SQL query by using tSnowflakeInput component?

Best regards

Sabrina

Re: Unloading from Snowflake to AWS S3 using Talend

vvazza10 — Wed, 02 Sep 2020 12:37:23 GMT

Yes, I am able to read the data. The execution fails when I use Full SQL Query String: "COPY INTO @my_ext_unload_stage/table.txt.gz

FROM table

single=true

max_file_size=4900000000;"

Re: Unloading from Snowflake to AWS S3 using Talend

JohnRMK — Thu, 03 Sep 2020 08:38:38 GMT

Hello,

tDBInput in talend is a data read component (input) and therefore the executed query must return data.

What you're trying to do is run a function to transfer data from Snowflake to Amazon and you don't read data (you're not actually getting data localy)

You have to use the tDBRow component to execute your query and it should work.

Dont forget the commit/Rollback op