How to load a Parquet file into Snowflake using tSnowflakeBulkExec component

Anonymous — Sat, 16 Nov 2024 05:28:03 GMT

I want to load data into Snowflake data warehouse. My data is in the form of Parquet files residing in AWS S3 bucket. I am trying to use the component - tSnowflakeBulkExec to do this task. Talend is giving an error saying - PARQUET cannot be resolved to a variable. I am using the following command in the Copy command options (Manual) of advanced settings :

"ON_ERROR='continue' FILE_FORMAT=(type=parquet compression=gzip)"

What am i supposed to do to resolve this error. Is tSnowflakeBulkExec the right component to load Parquet file residing in S3 into Snowflake. If not, then which component should i use to do the same.

Screenshots of Talend error are attached.

Thanks.

Re: How to load a Parquet file into Snowflake using tSnowflakeBulkExec component

Anonymous — Wed, 03 Jul 2019 09:30:15 GMT

Hello,

Talend 7.1.1 version does provide bulk component from which you can load data from s3 to Snowflake by using

tSnowflakeBulkExec componen. With the form of Parquet files, is it gzip compression file?

Best regards

Sabrina

topic Re: How to load a Parquet file into Snowflake using tSnowflakeBulkExec component in Talend Studio

How to load a Parquet file into Snowflake using tSnowflakeBulkExec component

Re: How to load a Parquet file into Snowflake using tSnowflakeBulkExec component

tSnowflakeBulkExec componen. With the form of Parquet files, is it gzip compression file?