File limit using tDropboxList

Anonymous — Tue, 23 Jan 2018 19:07:46 GMT

Hello everyone,

I'd like to know if anyone has encountered this same issue.

I'm using the tDropbox components in TOS for Data Integration (I'm on version 6.3.1) for listing and downloading all files from a specific folder in my Dropbox account. The job works very well, except that it stops at exactly 2000 files (while I have slightly more: 2400 -_-) without any error being printed on the console.

I did some research on Dropbox APIs, and it seems like the http endpoint https://api.dropboxapi.com/2/files/list_folder (which I'm guessing is the one being used here) has a limit on the maximum number of files that can be retrieved in one call which is exactly 2000. I've also noticed they added an optional parameter called "limit" that can be used to set the maximum number of results to return per request (here the link to the official documentation: https://www.dropbox.com/developers/documentation/http/documentation#files-list_folder).

My question is: are there any plans to make this option available on the tDropboxList component? Alternatively, is there some way I can download all my 2400 files without using the Dropbox components?

Thank you for your help.

Simona

Re: File limit using tDropboxList

Anonymous — Wed, 24 Jan 2018 08:08:10 GMT

Hello,

Could you please create a new feature jira issue on talend bug tracker?

https://jira.talendforge.org/secure/Dashboard.jspa

Best regards

Sabrina

Re: File limit using tDropboxList

Anonymous — Wed, 24 Jan 2018 09:31:31 GMT

Thank you, I just did: https://jira.talendforge.org/browse/TDI-39960

Re: File limit using tDropboxList

Anonymous — Fri, 26 Jan 2018 03:06:33 GMT

Hello,

Thanks for posting the jira link here.

Best regards

Sabrina

topic File limit using tDropboxList in Talend Studio

File limit using tDropboxList

Re: File limit using tDropboxList

Re: File limit using tDropboxList

Re: File limit using tDropboxList