topic Re: Sharepoint file download using tFilefetch or tHttpRequest in Talend Studio

Sharepoint file download using tFilefetch or tHttpRequest

Anonymous — Fri, 16 Nov 2018 19:31:31 GMT

I referred all the threads on community but could not really understand Why do I get 403 Forbidden error or HTTP 301 error while trying to download the file from SharePoint.

I need to clarify some things:

a) Which link in SharePoint to be used in tHttpRequest or tFileFetch, currently I need to download this file from sharepoint, so I am using link

https://xxxx.sharepoint.com/:/r/teams/ESPPSR/Shared%20Documents/ESP%20Project%20Documentation/Pxxxxxx%20-%20SPRNL/Architecture/XXXX%20Renewal%20Replacement%20PSR_06062018.pptx?d=w462b348117c94a92a24ecba9e806a247&csf=1&e=8ZdQA6

is this a correct type of link to be put in SharePoint?

b) I work on a virtual box so how do I provide my authentication details...should it be followed by domain or without domain?

Any help would be appreciated..

Re: Sharepoint file download using tFilefetch or tHttpRequest

Anonymous — Wed, 05 Dec 2018 07:57:11 GMT

Hello,

Could you please let us know if this article helps?

https://community.talend.com/t5/Migration-Configuration-and/While-accessing-a-file-from-Sharepoint-the-tHttpRequest/ta-p/43696

Best regards

Sabrina

Re: Sharepoint file download using tFilefetch or tHttpRequest

Anonymous — Wed, 09 Oct 2019 20:08:25 GMT

Hi All

I need to download one / multiple files from Share point Document Library using Talend Open Studio.

I have tried various components like tFileFetch and tHttpRequest however, both of them generate 403 forbidden error so haven't found a solution as yet.

I have also tried putting some headers however, still haven't managed to resolve the issue.

I have visited various threads however, haven't found any concrete solution to this one

Can you please share your experience if someone has done this or know the solution to this?

Re: Sharepoint file download using tFilefetch or tHttpRequest

tanjaj — Thu, 21 May 2020 12:57:32 GMT

Hi,

Here is how I succeeded to download and upload files from Sharepoint using Talend tHttpRequest component:

1. Get Sharepoint access token (here is really good tutorial how to do it https://global-sharepoint.com/sharepoint-online/in-4-steps-access-sharepoint-online-data-using-postman-tool/ )

2. After you test it in Postman go to Talend

3. Search for tHttpRequest component

4. Upload file:

- Choose POST method

- URL:

"https://{your-site}.sharepoint.com/sites/Customer/_api/web/getFolderByServerRelativeUrl('{name-of-document-library}')/Files/add(url='{name-of-file}',overwrite='true')"

- In Header put

key: "Autorization" value:"Bearer<space>sharepoint-access-key"

key: "Accept" value: "application/json;odata=verbose"

5. Download file:

- Choose GET method

-URL:

"https://{your-site}.sharepoint.com/sites/Customer/_api/web/getFolderByServerRelativeUrl('{name-of-document-library}')/Files('{file-to-download}')/$value"

- In Header put

key: "Autorization" value:"Bearer<space>sharepoint-access-key"

key: "Accept" value: "application/json;odata=verbose"

For more info about API: https://docs.microsoft.com/en-us/sharepoint/dev/sp-add-ins/working-with-folders-and-files-with-rest

If you have forbidden error - check your access key; if key is ok, then something is wrong with url, check where is your file actually.

Enjoy

upload.JPG
download.JPG

Re: Sharepoint file download using tFilefetch or tHttpRequest

nganapathy — Thu, 11 Jun 2020 21:12:55 GMT

Hi Tanjaj,

I followed the steps you mentioned. I am not getting any error. However I am not able to download the file. A file is downloaded with some sort of HTML content, I uploaded different types of files (.csv, xlsx). But I am not able to download any of the files using Talend. Could you please help me with this?

Thanks

Nandini

Re: Sharepoint file download using tFilefetch or tHttpRequest

tanjaj — Fri, 12 Jun 2020 09:52:13 GMT

Hi,

You can't download file at all or you can download some file but you see HTML content?

Do you have this $value at the end of GET url?

https://{your-site}.sharepoint.com/sites/Customer/_api/web/getFolderByServerRelativeUrl('{name-of-document-library}')/Files('{file-to-download}')/$value

And can you post screenshots of component settings?

Br,

Tanja

Re: Sharepoint file download using tFilefetch or tHttpRequest

nganapathy — Fri, 12 Jun 2020 22:12:14 GMT

Hi Tanjaj,

I have attached a screenshot of my SharePoint site page and talend component page. Could you please tell me how to download the file under the title car-sales.

I initially uploaded the file in Share Documents (under Documents section, the name is same as list). The talend screenshot is for the DHL/car_sales file.

I really appreciate your response.

Thank you

Nandini

sharepoint_screenshot.PNG
Component_Screenshot.PNG

Re: Sharepoint file download using tFilefetch or tHttpRequest

sidd — Mon, 14 Sep 2020 13:12:18 GMT

I am getting below error. do you have any idea on this.

[statistics] connecting to socket on port 3804

[statistics] connected

403 Forbidden

{"error":{"code":"-2147024891, System.UnauthorizedAccessException","message":{"lang":"en-US","value":"Access denied. You do not have permission to perform this action or access this resource."}}}

[ERROR] 09:10:58 tbbi_firm_etl.copy_of_tbc_pp_load_measure_dim_0_1.Copy_of_TBC_PP_LOAD_MEASURE_DIM- tHttpRequest_2 - 403 Forbidden

{"error":{"code":"-2147024891, System.UnauthorizedAccessException","message":{"lang":"en-US","value":"Access denied. You do not have permission to perform this action or access this resource."}}}

[statistics] disconnected

Re: Sharepoint file download using tFilefetch or tHttpRequest

AIjel — Sun, 08 Nov 2020 17:00:38 GMT

Hi xdshi

the link of the article you mentioned is broken

please share the good link

thanks

Re: Sharepoint file download using tFilefetch or tHttpRequest

Anonymous — Mon, 09 Nov 2020 06:36:26 GMT

Hello,

Could you please have a look at it?

https://community.talend.com/s/article/While-accessing-a-file-from-Sharepoint-the-tHttpRequest-component-fails-with-the-error-Request-failed-Forbidden-0oeoh

Best regards

Sabrina

Re: Sharepoint file download using tFilefetch or tHttpRequest

AIjel — Mon, 09 Nov 2020 09:17:27 GMT

that one works! thank you!

Re: Sharepoint file download using tFilefetch or tHttpRequest

Anonymous — Tue, 10 Nov 2020 04:02:59 GMT

Hello,

Great it works. Feel free to let us know if there is any further help we can give.

Best regards

Sabrina

Re: Sharepoint file download using tFilefetch or tHttpRequest

fh247630 — Wed, 24 Mar 2021 13:31:31 GMT

Hello xdshi and AIjel,@Xiaodi Shi @Ammar Ijel

Can you please send me the steps to access to a file in sharepoint?

I try to go to this link https://community.talend.com/s/article/While-accessing-a-file-from-Sharepoint-the-tHttpRequest-component-fails-with-the-error-

but the image into this link doesnt open.

Thank you by advance

Fawaz HADADEH

Re: Sharepoint file download using tFilefetch or tHttpRequest

Anonymous — Thu, 25 Mar 2021 07:26:58 GMT

Hello,

Are you referring to this image?

Re: Sharepoint file download using tFilefetch or tHttpRequest

muralam — Wed, 12 May 2021 11:53:25 GMT

@Nandini Ganapathy ,@Tanja Jovovic ,

I ahve follwed your steps but not able to download files from sharepoint and place them in local path. kindly help me out here?

Regards,

Meena