topic Re: Talend Databricks and connect to Azure Data Lake gen 2 in Talend Studio

Talend Databricks and connect to Azure Data Lake gen 2

Prakash3 — Sat, 16 Nov 2024 04:18:20 GMT

Dears,

I am Trying to pull csv data from Azure data lake gen 2 and pushing to database after the processing using big data batch job and data bricks is my spark cluster.

here i am unable to find the required property values for the Azure Connection.

anyone help on this.

Re: Talend Databricks and connect to Azure Data Lake gen 2

Anonymous — Tue, 29 Oct 2019 07:45:32 GMT

Hello,

Could you please let us know if this community article helps?

https://community.talend.com/t5/Design-and-Development/Process-data-stored-in-Azure-Data-Lake-Store-with-Databricks/ta-p/143100

Best regards

Sabrina

Re: Talend Databricks and connect to Azure Data Lake gen 2

Prakash3 — Wed, 30 Oct 2019 07:52:57 GMT

thanks for the article and i have already read the article but it is for Data Lake Gen 1 and actually i am working in Data Lake Gen 2 after i have completed the mentioned steps and got the below error, could you please help on this

com.microsoft.azure.datalake.store.ADLException: Error getting info for file /xxxx-xx/xx/xxx_xxxx.csv
Error fetching access token
Operation null failed with exception java.net.MalformedURLException : no protocol: "https://login.microsoftonline.com/sdfsdsdf-8df2-4435-8130-65sdfsde353c/oauth2/v2.0/token"
Last encountered exception thrown after 5 tries. [java.net.MalformedURLException,java.net.MalformedURLException,java.net.MalformedURLException,java.net.MalformedURLException,java.net.MalformedURLException]
[ServerRequestId:null]