topic Re: Retrieve an excel file from azure File Shares in Talend Studio

Retrieve an excel file from azure File Shares

Graced — Mon, 10 Aug 2020 11:02:16 GMT

--The Azure Storage platform includes the following data services: Blob Containers, File Shares, Queues and Tables.

I have a Talend task to connect to MS Azure and retrieve two set of files from Blob Containers and File Shares.

I retrieved the files from azure Blob Containers successfully (using tAzureStorageGet).

I failed to get the excel file from azure File Shares.

What component should I use? May I get some advise here? Thank you!

Re: Retrieve an excel file from azure File Shares

Anonymous — Tue, 11 Aug 2020 07:22:03 GMT

Hello,

There is no standard components in Talend to access the content of files that are present in Azure share.

Could you please try this solution to see if it works for you?

Create the Microsoft Azure File share using Microsoft Storage account and upload the files which needs to be accessed by Talend Job
Mount the created file share where Talend job needs to run. For more information on how to mount the drive to local OS please refer link.
Make sure you can see the files which were uploaded after mounting the drive
Create a Talend job which will access these files from this mounted drive. Make sure you are browsing the path of the file from mounted drive as highlighted in below screenshot
Run the job to see the output of file contents written in Talend Output console

Re: Retrieve an excel file from azure File Shares

Graced — Tue, 11 Aug 2020 10:04:03 GMT

Thanks xdshi.

You have addressed my question. So the standard Talend component does not exist so far, for retrieving files from azure File Shares.

I read your method, if mounting was done successfully this way should work.

My job server is linux, so another microsoft doc meets my case. https://docs.microsoft.com/en-us/azure/storage/files/storage-how-to-use-files-windows

Azure file shares can be mounted in Linux distributions using the SMB kernel client. After mounting the drive, just treat Azure file shares as a "local" folder.

Re: Retrieve an excel file from azure File Shares

JohnRMK — Wed, 12 Aug 2020 08:42:38 GMT

Hello,

does it work correctly? I had the same problem with files in a remote server and the problem was when i running with the JobServer.

The talend user did not have access so if you have an access denied error you have to look at the users side and the jobserver config.

Otherwise if you are on linux, you can use the tFTP * components

Re: Retrieve an excel file from azure File Shares

juju1983 — Tue, 14 Jun 2022 07:27:02 GMT

Same problem... Do you have any update ?

Re: Retrieve an excel file from azure File Shares

Anonymous — Tue, 14 Jun 2022 08:06:00 GMT

Hello @julien83

The standard Talend component does not exist so far, for retrieving files from azure File Shares.

Could you please give us a little bit information and background about your use case and requirement? So that we could see if there is a good solution for you.

Best regards

Sabrina

Re: Retrieve an excel file from azure File Shares

juju1983 — Tue, 14 Jun 2022 08:15:29 GMT

Hi,

We have a Azure file share partition (https://docs.microsoft.com/en-us/azure/storage/files/storage-how-to-use-files-windows) use by 2 nœuds in the cluster .

Our issue it’s when we run the job from the remote engine we get an error message that it can’t access to the folder

Same problem as mentioned here : https://community.talend.com/s/question/0D53p00007yUavrCAC/retrieve-an-excel-file-from-azure-file-shares?language=en_US

We mapped the disk in the os to this azure file share but it still not work. When we build the job and run it directly on the server without using remote engine it works fine .

Regards

Re: Retrieve an excel file from azure File Shares

Anonymous — Tue, 14 Jun 2022 08:41:59 GMT

Hello,

Could you please clarify in which Talend version/edition you are?

It seems to be a new feature for remote engine. We will make an investigation on your issue and then come back to you asap.

Best regards

Sabrina

Re: Retrieve an excel file from azure File Shares

juju1983 — Tue, 14 Jun 2022 08:53:13 GMT

Thanks for your feedback.

I have api services licences and the 7.31 for tunrime (the Patch_20220513_R2022-05_v1-RT-7.3.1 ) and Talend-RemoteEngine-V2.12.0-239-Windows for remote engine.

Regards

Re: Retrieve an excel file from azure File Shares

juju1983 — Wed, 15 Jun 2022 14:25:55 GMT

Using UNC it works, thank you.

Regards

Re: Retrieve an excel file from azure File Shares

Anonymous — Thu, 16 Jun 2022 02:49:08 GMT

Hello,

Thanks for your feedback.

It is very great that you are able to retrieve files from azure File Shares using UNC in a remote server.

Best regards

Sabrina