Updating data using tDBOutput is taking longer time

[DBS1]

Hi

I am trying to update data using tDBOutput. The total number of records are 7000 but is taking more than 2 hrs for all the data to get updated.

Please help me in providing solution to make update process faster.

Thanks

Dhanoop B S​

[Anonymous]

Hello,

What's your job rate of records/second? Could you detail a little bit more your job design/work flow? Screenshots will be preferred.

Generally speaking, the followings aspects could affect the job performance:

1. The volume of data, read a large of data set, the performance will degrade, but in your case, there are total ~7000 records, it is a small data set.

2. The structure of data, if there are so many columns on input source, it will consume many memory and much time for transferring the data during the job execution.

3. The database connection, the job always runs better if the database is installed on local, if the database is on another machine, even you are on VPN, you may have the congestion and latency issues.

Best regards

Sabrina

[DBS1]

Hi

I am running the job from TMC and I am directly loading the data from input excel into the table.

The table is containing around 220 columns. But in my input excel I am just providing 3 fields of which one is key field and the other two fields which I need to update in the table.

In tDboutput, Basic settings Action on table is selected as Update and in advanced settings Batch size is given as 10000

Thanks

Dhanoop

[Anonymous]

Hello,

It is possible to enable batch update in tDBOutPut.

You are able to get the 'Batch size' option when 'action on Data ' is Update or Delete.

Could you please post your job design screenshots here which will be helpful for us to get your current situation?

Best regards

Sabrina

[DBS1]

Hi

In configuration, the batch size is already set to 10000. Please find the job flow.