Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
See why IDC MarketScape names Qlik a 2025 Leader! Read more
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2013-12-04 09:32 PM

Extract a billion records using Talend Data Integration

Hi,
May i know is this TOS for data integration might have a capability to extract a billions records?
I need to extract out a billions of records from Oracle/db2 database.
Anyone have any experience on this? 0683p000009MPcz.png
Regards,
Ommie
Labels (2)
Labels
222 Views
0 Likes
2 Replies
Anonymous
Not applicable
‎2013-12-05 01:13 AM
Author

Hi,
Here is a similar topic https://community.talend.com/t5/Design-and-Development/Data-Size-handled-by-Talend-open-studio-for-D....
Best regards
Sabrina
222 Views
0 Likes
Anonymous
Not applicable
‎2014-01-18 06:55 AM
Author

Talend does not have a limitation in processing number of row. You can process as many rows as you want/have. It is always a matter of efficiency and resources. Billions of row - why not.
I would always try to separate a chunk of rows and avoid trying to process all rows at once.
Processing billions of rows without separating it in chunks will lead into a nightmare on the productive system - regardless which tool do you use to do that.
222 Views
0 Likes