topic Re: multithreading for large xls file in Talend Studio

multithreading for large xls file

Anonymous — Tue, 30 Jun 2015 07:15:41 GMT

Hi,
I have excel file with 10M records.
when i try to load it into DB with multithreading enabled and disabled it doesn't show much difference in excecution time.
then i found
https://help.talend.com/search/all?query=How+to+automatically+enable+parallelization+of+data+flows+for+better+performance&content-lang=en
article.
I want to test if this works but it says i need to be subscribed to one of the Talend Platform solutions or Big Data solutions V5.3.1 or later.
how can i test that??

Re: multithreading for large xls file

Anonymous — Tue, 30 Jun 2015 08:05:34 GMT

Hi,
Parallelization of data flows feature is only available in Talend Platform solutions.
Feel free to send an email to sale@talend.com with your requirement. Our colleagues from sale team will see if it is possible to provide you with a free trial Talend Platform product for testing.

I have excel file with 10M + records.
when i try to load it into DB with multithreading enabled and disabled it doesn't show much difference in excecution time.

How did you set your t<DB>output component? Have you tried to change "Commit every" option to get better performance at execution?

Best regards
Sabrina

Best regards
Sabrina

Re: multithreading for large xls file

Anonymous — Tue, 30 Jun 2015 09:33:08 GMT

Hi,
I currently I am using Talend Open Studio for Data Integration. version : 5.6.1.XXX .
are you saying I need to purchase license In order to avail this feature???

How did you set your t<DB>output component? Have you tried to change "Commit every" option to get better performance at execution?

yes...I tried various combinations of commit every and batch execution .
we are more interested in Parallelization of data flows . I will contact talend sales team as you suggested .
Thanks,
Pankaj

Re: multithreading for large xls file

Anonymous — Tue, 30 Jun 2015 09:42:40 GMT

Hi,
So far, talend provides community users with a free trial (30days) Talend Enterprise for Data Integration.
For your requirement(we are more interested in Parallelization of data flows), you have to use Talend Platform solutions.

Feel free to send an email to sale@talend.com with your requirement. Our colleagues from sale team will see if it is possible to provide you with a free trial Talend Platform product for testing.

As we suggested before , please contact talend sales team to see if there is a free trial Talend Platform product for testing.
Don't hesitate to let us know if it is OK with you.
Best regards
Sabrina

Best regards
Sabrina

Re: multithreading for large xls file

Anonymous — Tue, 30 Jun 2015 13:36:28 GMT

Hi,
I have sent mail to your sales team.now I am waiting for response.
Thanks,
Pankaj

Re: multithreading for large xls file

Anonymous — Wed, 01 Jul 2015 10:01:40 GMT

hi,
I installed Talend Enterprise for data integration V5.6.2 with license for 30days.
I still cant get set parallelization option.
am I missing something??? Is the version wrong ???

must subscribed to one of the Talend Platform solutions or Big Data solutions V5.3.1 or later.

what does this mean exactly ..
p.s. - no response from your sales team.
thanks,
Pankaj

Re: multithreading for large xls file

Anonymous — Wed, 01 Jul 2015 10:23:56 GMT

Hi,

For your requirement (we are more interested in Parallelization of data flows), you have to use Talend Platform solutions.

This feature is only available in Talend Platform Solutions not Talend Enterprise for Data Integration.

Best regards
Sabrina

Re: multithreading for large xls file

Anonymous — Thu, 02 Jul 2015 04:13:35 GMT

Hi,
Do you get any response from talend sales team?

Best regards
Sabrina

Re: multithreading for large xls file

Anonymous — Mon, 06 Jul 2015 06:55:25 GMT

Hi,
No.I haven't got any response from talend sales team.
Thanks,
Pankaj