Skip to main content
Announcements
A fresh, new look for the Data Integration & Quality forums and navigation! Read more about what's changed.
cancel
Showing results for 
Search instead for 
Did you mean: 
Graced
Contributor

Retrieve an excel file from azure File Shares

--The Azure Storage platform includes the following data services: Blob Containers, File Shares, Queues and Tables. 

I have a Talend task to connect to MS Azure and retrieve two set of files from Blob Containers and File Shares. 

I retrieved the files from azure Blob Containers successfully (using tAzureStorageGet).

I failed to get the excel file from azure File Shares.

What component should I use? May I get some advise here? Thank you!

Labels (3)
1 Solution

Accepted Solutions
juju1983
Contributor II

Using UNC it works, thank you.

Regards

View solution in original post

10 Replies
Anonymous
Not applicable

Hello,

There is no standard components in Talend to access the content of files that are present in Azure share.

Could you please try this solution to see if it works for you?

  1. Create the Microsoft Azure File share using Microsoft Storage account and upload the files which needs to be accessed by Talend Job0693p000009IHA2AAO.png
  2. Mount the created file share where Talend job needs to run. For more information on how to mount the drive to local OS please refer link.0693p000009IHA7AAO.png
  3. Make sure you can see the files which were uploaded after mounting the drive0693p000009IHACAA4.png
  4. Create a Talend job which will access these files from this mounted drive. Make sure you are browsing the path of the file from mounted drive as highlighted in below screenshot0693p000009IHAHAA4.png
  5. Run the job to see the output of file contents written in Talend Output console0693p000009IHARAA4.png
Graced
Contributor
Author

Thanks xdshi.

You have addressed my question. So the standard Talend component does not exist so far, for retrieving files from azure File Shares.

I read your method, if mounting was done successfully this way should work.

 

My job server is linux, so another microsoft doc meets my case. https://docs.microsoft.com/en-us/azure/storage/files/storage-how-to-use-files-windows

Azure file shares can be mounted in Linux distributions using the SMB kernel client. After mounting the drive, just treat Azure file shares as a "local" folder.

 

JohnRMK
Creator II

Hello,

does it work correctly? I had the same problem with files in a remote server and the problem was when i running with the JobServer.

The talend user did not have access so if you have an access denied error you have to look at the users side and the jobserver config.

Otherwise if you are on linux, you can use the tFTP * components

juju1983
Contributor II

Same problem... Do you have any update ?

Anonymous
Not applicable

Hello @julien83

The standard Talend component does not exist so far, for retrieving files from azure File Shares.

Could you please give us a little bit information and background about your use case and requirement? So that we could see if there is a good solution for you.

Best regards

Sabrina

juju1983
Contributor II

Hi,

 

We have a Azure file share partition (https://docs.microsoft.com/en-us/azure/storage/files/storage-how-to-use-files-windows) use by 2 nœuds in the cluster .

Our issue it’s when we run the job from the remote engine we get an error message that it can’t access to the folder 

 

Same problem as mentioned here : https://community.talend.com/s/question/0D53p00007yUavrCAC/retrieve-an-excel-file-from-azure-file-sh...

 

We mapped the disk in the os to this azure file share but it still not work. When we build the job and run it directly on the server without using remote engine it works fine .

 

Regards

Anonymous
Not applicable

Hello,

Could you please clarify in which Talend version/edition you are?

It seems to be a new feature for remote engine. We will make an investigation on your issue and then come back to you asap.

Best regards

Sabrina

juju1983
Contributor II

Thanks for your feedback.

I have api services licences and the 7.31 for tunrime (the Patch_20220513_R2022-05_v1-RT-7.3.1 ) and Talend-RemoteEngine-V2.12.0-239-Windows for remote engine.

Regards

juju1983
Contributor II

Using UNC it works, thank you.

Regards