Job Performance Optimization

[abhi90]

Hi All,

I have designed the Job in the format attached.I am doing Data Conversion of All the Columns from String to Respective target One's and doing ERROR CHECK. I have checked USECURSOR in toracleInPut Component and in Both toracleoutput I have used Batch as 500000 which is much more than my expected Data to be loaded. What I am seeing is My Data getting fetched in 5.32 Seconds but It is taking Time then to commit or ending the Job. I am using both OracleOutput Component using "USE EXISTING CONNECTION " using my Connection established in my Job. WithOut using toracleCommit getting Throughput 1108Rows/sec and after using tOracleCommit getting as 1233Rows/Sec Now. Any way to make it more faster?

@rhall, @manodwhb, @vboppudi, @cterenzi, @vapukov, @shong, @xdshi

[abhi90]

Hi @xdshi, @rhall,

Please find my Job Screenshot attached.I am going to attach my remaining 3 Snapshots in Next Comment.

Hi @rhall,

Yess I have tried your options. But still no Improvement Dont know How I will improve my Job performance littlebit Better.

I have tried today toracleBulkExec. Data File was generating but was getting 

SQL*Loader-704: Internal error: ulconnect: OCIEnvCreate [-1] Error in toracleBulkExec component

Job_Overall.JPG
tmap.JPG
tmap_ERROR_FLAG.JPG
toracleinput_Advanced.JPG

[abhi90]

Remaining 3 Snapshots of Job 

toracleinput_Basic.JPG
toracleoutput_Advanced.JPG
toracleoutput_Basic.JPG

[Anonymous]

What was the performance before you made the changes I suggested, and what was it after (rows per second)? 

[abhi90]

Hi @rhall,

with keeping Batch Size as 6000 got Throughput as 983R/Sec,with 9000 got Throughput as 993R/Sec.