Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello,
I am trying to perform Bulk load from Snowflake External stage to Snowflake table.
Snowflake external stage refers to files from S3 bucket.
Attaching the Talend Flow with component properties.
Note: "S3_BUCK_STAGE" is external stage created.
While running the code through talend Studio, i am getting "Column not found" error. Screenshot is attached.
More information about code:
1)S3 file structure and snowflake table structure and its column names are same.
2)CSV file is staged from S3 in snowflake
3)All the column data types in table are String type
Could you please help me with the issue.
Please let me know for any more details.
Thank you
Hello,
I think there is no option to load data from External Stage created in Snowflake which points to S3.
What i tried is using Outputbulk and bulkexec components where S3 data is staged into Internal Snowflake stage using OutputBulk component and then loaded in Snowflake table using BulkExec component.
This solution worked fine but is taking time to load data.
Now i am trying to performance tune the existing design.
thank you for your help
Hi Rohit,
Congratulations, you seems to have cracked the reason for the rows_loaded column not found issue. Please manage to share the root cause. Does changing it staging to S3 resolves the issue or it is something else.
Thanks,
Shiv