DB2 bulk update from csv file.

[Anonymous]

Hi,

I have update statements ready in csv file to update DB2 table.

tFileInputDelimited >> tJavaRow >> tDB2Row

As per above design I am reading update statement, stored it in global variable and called in next tDB2Row component.
Its working fine, but now a days data/update statements increases and it will take more time to execute.

Update statements are prepared by another process and stored in csv file. Here table name and its schema also changing every run, but update statement is correct with table name and its updating column with where condition.

Please give me any optimized solution for this scenario.

Regards
Rahul N

[Anonymous]

Hi,

    One option is to use the Bulk component of Talend available for DB2. But for this, you need to provide the data in appropriate file format.

If you do not want to use the Bulk component, another method is to use tParallelize to process multiple record batches in parallel. Could you please try one of this methods and let us know whether it helped to resolve your problem? The sample scenarios are available in Help.talend.com

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

[Anonymous]

Hi Nikhil,

Thanks for your reply.

As I mentioned earlier I have file with update statements, not data file and as per my understanding tDBBulkExce component require data file.

I will try to create data file instead of update statements, but I want to know about how this tDbBulkExce component work? Suppose I have more than 20 lakh records to update from file then is it hit database 20 lakh times for update or any batch execution to minimize the database hit or any other way. Please let me know your thoughts on this.

Regards

Rahul N

[Anonymous]

Hi,

   Since it is bulk component, the data will be processed as batches and not at individual record levels.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂