topic Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend in Talend Studio

Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

Anonymous — Sat, 16 Nov 2024 05:00:47 GMT

hi,

I want to load data stored on Azure Data Lake Storage (Gen 1) to Azure SQL Database using talend.

Can anyone help me in this

Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

iamabhishek — Mon, 12 Aug 2019 16:59:24 GMT

From Talend 7.1 there is support for ADLS but this requires additional integration with Azure Databricks. Azure Databricks is a consumption-based Spark managed service that simplifies processing of Big Data and Artificial Intelligence workloads. The component is - tAzureFSConfiguration . Blog post.
But there is another way - using Powershell. Use tSystem to execute Powershell script which would export ADLS item. The export command would download a file. Once the file is downloaded to your Talend server you could use the requisite tFileInputXXX commands to read from the file and then use tMSSqlOutput components to write to database.

Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

Anonymous — Tue, 13 Aug 2019 07:44:53 GMT

Thanks.

I will Check

Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

Anonymous — Sat, 17 Aug 2019 21:16:41 GMT

Two options, BD Jobs or Data Integration jobs..

For Data Integration you have info here:https://help.talend.com/reader/98wTdxOyJjhkll4BXt6Xcw/rzE1cW6_Jsslh~TM5GQ1Uw

For BD/Spark:https://help.talend.com/reader/vL1PhaFdyq7wvci0YX83pg/Xock9DFqZ7AMN_ZgzqOeuA