topic How to use tSQLDWHBulkExec for Bulk Insertion from ADLS into SQL Data Warehous? in Talend Studio

How to use tSQLDWHBulkExec for Bulk Insertion from ADLS into SQL Data Warehous?

Anonymous — Sat, 16 Nov 2024 05:01:34 GMT

I want to load data table from Azure Data Lake Storage into Azure SQL Data Warehouse and I want to use tSQLDWHBulkExec component for faster load.

I went through the documentation given by Talend :- https://help.talend.com/reader/ygbIheFXvENtgRu4XG5LFg/NQ8FbHnO_Y5XcyiudcSgsw

but it is not working for me.

This component run successfully but doesn't load data into SQL DW and not throwing any error.

Re: How to use tSQLDWHBulkExec for Bulk Insertion from ADLS into SQL Data Warehous?

Anonymous — Fri, 09 Aug 2019 14:50:19 GMT

Hi,

Could you please add a connection component before your component and select auto commit option?

If the error persists, could you please share the component basic and advanced tab screenshots after masking confidential data.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: How to use tSQLDWHBulkExec for Bulk Insertion from ADLS into SQL Data Warehous?

Anonymous — Fri, 09 Aug 2019 16:06:24 GMT

I have add a tSQLDWHConnection component (with enabled auto commit) before tSQLDWHComponent. But it doesn't throw any error and not inserting data from ADLS into Azure SQL DW (see below diagram)

On the tSQLDWHBulkExec side, the component only asks regarding connection details and not asking for any table. How it is possible by without table name.(see below diagram)

What should I do then?

Re: How to use tSQLDWHBulkExec for Bulk Insertion from ADLS into SQL Data Warehous?

Anonymous — Fri, 09 Aug 2019 16:55:17 GMT

Hi,

That is interesting! I could see that table name is a mandatory filed for this component and you can even browse the details by clicking the browse more button.

Could you please create a support ticket so that they can remotely check the issue through screen sharing session? Since you are having confidential connection information, we may not be able to check the details through community in realistic manner.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: How to use tSQLDWHBulkExec for Bulk Insertion from ADLS into SQL Data Warehous?

Anonymous — Fri, 09 Aug 2019 17:25:01 GMT

Table name option also available for my component. (see below diagram)

That table option is available for Azure SQL Data Warehouse side but Azure Storage Connection don't have table option ie. which particular file wants to inert into SQL DW.