Talend Integration with SharePoint

[JBristow]

We currently have a number of integrations where we pull/push data to/from NAS drives throughout the company. As part of our strategic direction - NAS drives are being migrated to O365 SharePoint locations. This means our Talend jobs will need the ability to connect to, pull down from; push to; and delete from  - O365 SharePoint sites. I've googled everything related to this and there's not a clear-cut, easy solution - i.e. you don't just drop the "tFileList" component on your workflow and have access to the files. 🙂

I wanted to get other people's thoughts/input into the "Best" way to achieve access to SharePoint files via Talend. Have people use Third Party software/controls? Have people developed Java or C# services and called those from Talend? Have people used tSOAP to connect to SharePoint (i.e. Copy.asmx) and what  was your experience like? Could you access/remove/deliver data files easily from/to SharePoint with any of these methods? 

It's a general question to see what others have experienced.

Thanks for any input on this.

[Anonymous]

Hi,

     There are no direct components to process the data in SHarepoint. But you can use Talend SOAP/REST components to interact with Sharepoint.

     I also noticed two third party blogs abouth integration between Talend and SHarepoint. Could you please try these?

https://www.cdata.com/kb/tech/sharepoint-jdbc-talend.rst

https://www.datalytyx.com/how-to-extract-list-items-from-sharepoint-on-premise-into-talend-gated/

    Another way is to create the custom component or routine in Talend for your specific need to integrate between Talend and Sharepoint.

Warm Regards,

Nikhil Thampi

[JBristow]

Thanks...I've actually been to these 2 links over the past 2 days...and also am exploring a custom component. 

I'm looking for an easy solution - and there doesn't appear to be any. I'm not a big fan of picking up and dropping data files used for ETL work on a SharePoint site....but it looks like that's the solution I'm going to have to develop. SharePoint - in my opinion - just makes everything more difficult for automated processes like this.

Thanks for the input - much appreciated!

[Anonymous]

Hi @ris.tan 

Did you end up finding a solution to this issue as I am exploring a solution to the same problem.

I need to download one / multiple files from Sharepoint Document Library using Talend.

I have tried various components like tFileFetch and tHttpRequest however, both of them generate 403 forbidden error so haven't found a solution as yet.

Can you please share your experience on how you solved this?

Regards

Raminder

[JBristow]

We aren't downloading from SharePoint at this time. We may revisit in the near future - but at this time any data files needed for Talend processing are required to be dropped to a NAS location we can access. One Drive is basically a NAS - so at some point we'll need to work with our SharePoint Team to figure out if this is possible.

[Anonymous]

Hi, my 2 cents

as i never found a solution to push directly xlsx databases exports from talend to Sharepoint O365 collaboration site, i simply connected a Win server to the library of the sharepoint site with onedrive, shared this local folder, and push xlsx to this location.

one drive upload to the O365 library and my users are notifyed that there is a new file on the collaboration site.

Its a prety dirty way, but i didnt find another 😕

WW