Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
hi,
I want to load data stored on Azure Data Lake Storage (Gen 1) to Azure SQL Database using talend.
Can anyone help me in this
From Talend 7.1 there is support for ADLS but this requires additional integration with Azure Databricks. Azure Databricks is a consumption-based Spark managed service that simplifies processing of Big Data and Artificial Intelligence workloads. The component is - tAzureFSConfiguration . Blog post.
But there is another way - using Powershell. Use tSystem to execute Powershell script which would export ADLS item. The export command would download a file. Once the file is downloaded to your Talend server you could use the requisite tFileInputXXX commands to read from the file and then use tMSSqlOutput components to write to database.
Thanks.
I will Check
Two options, BD Jobs or Data Integration jobs..
For Data Integration you have info here:https://help.talend.com/reader/98wTdxOyJjhkll4BXt6Xcw/rzE1cW6_Jsslh~TM5GQ1Uw
For BD/Spark:https://help.talend.com/reader/vL1PhaFdyq7wvci0YX83pg/Xock9DFqZ7AMN_ZgzqOeuA