Hello,
I have created a delta load using Talend.
Everything is working fine except updating the columns seems to take forever.
In tPostresqlOutput I am using 'Update' in Action on data.
The table to be updated has more than 7 million rows but I am updating only 500 rows but still it is taking too much time.
Is there a way to fix this issue?
I might be updating even bigger tables later so this is a big problem for me.
Data is coming from mysql and going to postgresql database with Talend.
I tested by updating around 1000 rows with Pgadmin it took 3 seconds to update.
I used id for update key it is an integer.
I found a way to speed it up. I inserted updated rows in a temp table and updated the target table from this temp table.
This really made it fast.