Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Streamlining user types in Qlik Cloud capacity-based subscriptions: Read the Details
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2012-11-14 11:05 PM

How to do Bulk Load for InfiniDB

Hi guys,
I'm having a hard time using Talend when inserting 100millions up to 300millions of data because of the "Heap memory" exception. And as a quick workaround, I wanted to use the cpimport utility or the bulk load of InfiniDB in my talend jobs.
Can anyone show me an example of this scenario? Even a simple job below will do Smiley Happy
tBulkLoad--><cpimport>-->tMySQLOuput
Thanks so much!
Labels (2)
Labels
370 Views
0 Likes
3 Replies
Anonymous
Not applicable
‎2012-11-15 02:25 AM
Author

Hi
Which component are you using for InfiniDB? tJDBCxxx component? As I seen, Talend does not provide proprietary components for InfiniDB.
370 Views
0 Likes
Anonymous
Not applicable
‎2012-11-15 02:28 AM
Author

Hi shong,
Actually, I'm thinking of a shell script that will run the bulk loader,maybe two scripts it. Is it possible?
370 Views
0 Likes
Anonymous
Not applicable
‎2012-11-15 11:23 PM
Author

Hi shong,
Actually, I'm thinking of a shell script that will run the bulk loader,maybe two scripts it. Is it possible?

I know little about InfiniDB database, however, if the shell script can be called and executed from command prompt, you can use tSystem component to execute the script in Talend.
370 Views
0 Likes