Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

multithreading for large xls file

Hi,
I have excel file with 10M records.
when i try to load it into DB with multithreading enabled and disabled it doesn't show much difference in excecution time.
then i found
https://help.talend.com/search/all?query=How+to+automatically+enable+parallelization+of+data+flows+f...
article.
I want to test if this works but it says i need to be subscribed to one of the Talend Platform solutions or Big Data solutions V5.3.1 or later.
how can i test that??
Labels (2)
8 Replies
Anonymous
Not applicable
Author

Hi,
 Parallelization of data flows feature is only available in Talend Platform solutions.
Feel free to send an email to sale@talend.com with your requirement. Our colleagues from sale team will see if it is possible to provide you with a free trial Talend Platform product for testing.

I have excel file with 10M + records.
when i try to load it into DB with multithreading enabled and disabled it doesn't show much difference in excecution time.


How did you set your t<DB>output component? Have you tried to change "Commit every" option to get better performance at execution?

Best regards
Sabrina

Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
I currently I am using Talend Open Studio for Data Integration. version : 5.6.1.XXX .
are you saying I need to purchase license In order to avail this feature???
How did you set your t<DB>output component? Have you tried to change "Commit every" option to get better performance at execution?

yes...I tried various combinations of commit every and batch execution .
we are more interested in Parallelization of data flows . I will contact talend sales team as you suggested .
Thanks,
Pankaj
Anonymous
Not applicable
Author

Hi,
So far, talend provides community users with a free trial (30days) Talend Enterprise for Data Integration.
For your requirement(we are more interested in Parallelization of data flows),  you have to use Talend Platform solutions.
Feel free to send an email to sale@talend.com with your requirement. Our colleagues from sale team will see if it is possible to provide you with a free trial Talend Platform product for testing.

As we suggested before , please contact talend sales team to see if there is a free trial Talend Platform product for testing.
Don't hesitate to let us know if it is OK with you.
Best regards
Sabrina


Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
I have sent mail to your sales team.now I am waiting for response.
Thanks,
Pankaj
Anonymous
Not applicable
Author

hi,
I installed Talend Enterprise for data integration V5.6.2 with license for 30days.
I still cant get set parallelization option.
am I missing something??? Is the version wrong ???
must subscribed to one of the Talend Platform solutions or Big Data solutions V5.3.1 or later.

what does this mean exactly ..
p.s. - no response from your sales team.
thanks,
Pankaj
Anonymous
Not applicable
Author

Hi,
 
For your requirement (we are more interested in Parallelization of data flows),  you have to use Talend Platform solutions.
 
This feature is only available in Talend Platform Solutions not Talend Enterprise for Data Integration.
 
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
Do you get any response from talend  sales team?

Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
No.I haven't got any response from talend sales team.
Thanks,
Pankaj