topic Re: UPDATE Action ==== TOO LONG Times ==== in Talend Studio

UPDATE Action ==== TOO LONG Times ====

Anonymous — Sat, 16 Nov 2024 13:57:28 GMT

HI
I would like to say about the UPDATE action on table takes too much times, the methode only which I found is to work by a temporary table then execute the stored procedure that makes the job of INSERT or Update
Damage that Talend manages still badly Update Action
Thanks

Re: UPDATE Action ==== TOO LONG Times ====

Anonymous — Thu, 14 May 2009 08:32:12 GMT

Hi,
The update actions are made through the java.sql library and your SGBD*. If you find them too slow, maybe you should reconsider your job design because as far as I know Talend only helps you to generate java code, its up to you to optimize what can/could be.
Anyway, a picture/description of your job could be useful if you want somebody to help you.
Cheers,
Diane
*it's the french name but I guess it's not a problem for you

Re: UPDATE Action ==== TOO LONG Times ====

Anonymous — Thu, 14 May 2009 09:16:53 GMT

Merci Diane pour ta réponse!
pour avoir travailler sur Talend depuis maintenant quelques mois, je peux t'assurer que les update dans les actions sur les tables est à eviter absolument car pour une certaine volumétrie cela devient très vite infernal et le temps est considérablement grand....
c'est vrai que talend génère derrière du java, mais je pense que l'optimisation (algorithme des update??) est à améliorer si ce n'est pas déja fait.
cordialement

Re: UPDATE Action ==== TOO LONG Times ====

Anonymous — Thu, 14 May 2009 13:05:45 GMT

I never faced such a problem with update, and I have no idea why you are suffering them. Did you test OutputBulk component? In a lot of situations they are much faster, however they need HD space.
You can also try tOutputBatch from the Ecosphere, it could improve performances too.

Re: UPDATE Action ==== TOO LONG Times ====

Anonymous — Thu, 14 May 2009 13:28:44 GMT

THX I will try these components, tOutputBatch seems interessant
I want ask you about OutputBulk, what's the difference with tXXXOuput? in which case we use it?
thx lot

Re: UPDATE Action ==== TOO LONG Times ====

Anonymous — Thu, 14 May 2009 14:08:33 GMT

There are three components around the "bulk" concept (in fact it uses SQL*Loader):
- tXXXOutputBulk: writes data in a delimited file
- tXXXBulkExec: loads data from a delimited file into a DB using SQL*Loader
-tXXXOutputBulkExec: combines the previous two, skipping a possible data modification and directly writind and loading datas in DB using a delimited file as buffer.
All these components can use multithreading, improving their speed.
Hope it helps

Re: UPDATE Action ==== TOO LONG Times ====

Anonymous — Thu, 14 May 2009 14:28:13 GMT

ok thank you so much, very interesting!
thx

topic Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*= in Talend Studio

UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

Re: UPDATE Action =*=*=*= TOO LONG Times =*=*=*=

topic Re: UPDATE Action ==== TOO LONG Times ==== in Talend Studio

UPDATE Action ==== TOO LONG Times ====

Re: UPDATE Action ==== TOO LONG Times ====

Re: UPDATE Action ==== TOO LONG Times ====

Re: UPDATE Action ==== TOO LONG Times ====

Re: UPDATE Action ==== TOO LONG Times ====

Re: UPDATE Action ==== TOO LONG Times ====

Re: UPDATE Action ==== TOO LONG Times ====