topic Re: DB2 bulk update from csv file. in Talend Studio

DB2 bulk update from csv file.

Anonymous — Sat, 16 Nov 2024 06:11:08 GMT

Hi,

I have update statements ready in csv file to update DB2 table.

tFileInputDelimited >> tJavaRow >> tDB2Row

As per above design I am reading update statement, stored it in global variable and called in next tDB2Row component.
Its working fine, but now a days data/update statements increases and it will take more time to execute.

Update statements are prepared by another process and stored in csv file. Here table name and its schema also changing every run, but update statement is correct with table name and its updating column with where condition.

Please give me any optimized solution for this scenario.

Regards
Rahul N

Re: DB2 bulk update from csv file.

Anonymous — Tue, 02 Apr 2019 09:17:49 GMT

Hi,

One option is to use the Bulk component of Talend available for DB2. But for this, you need to provide the data in appropriate file format.

If you do not want to use the Bulk component, another method is to use tParallelize to process multiple record batches in parallel. Could you please try one of this methods and let us know whether it helped to resolve your problem? The sample scenarios are available in Help.talend.com

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: DB2 bulk update from csv file.

Anonymous — Tue, 02 Apr 2019 16:50:15 GMT

Hi Nikhil,

Thanks for your reply.

As I mentioned earlier I have file with update statements, not data file and as per my understanding tDBBulkExce component require data file.

I will try to create data file instead of update statements, but I want to know about how this tDbBulkExce component work? Suppose I have more than 20 lakh records to update from file then is it hit database 20 lakh times for update or any batch execution to minimize the database hit or any other way. Please let me know your thoughts on this.

Regards

Rahul N

Re: DB2 bulk update from csv file.

Anonymous — Wed, 03 Apr 2019 07:06:45 GMT

Hi,

Since it is bulk component, the data will be processed as batches and not at individual record levels.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂