Talend Job is taking more time to complete execution

[Rajkumar_J]

Hi,

I am working on TOS. In this i have created a certain number of jobs and done schedule through 'windows task scheduler'.

My problem is, sometimes the job is getting completed within 2 mins and sometimes the same job is taking more time (approx 2 hrs) to complete the execution.

What is the reason for this and how could it be rectified?

[manodwhb]

@uganesh ,Need to analyze that ,when it took long time how much data was processing comparatively when it took 2 mins to complete and when it was executing longtime other tasks are running.

[Rajkumar_J]

I have analyzed that also, it seems to be same count 8 lakhs record.

For 8 lakhs records, sometimes it is getting completed within 2 mins and for the same amount of data it is taking more time.

Regarding execution time - the job got executed in morning when there is no updates happens in source.

[manodwhb]

@uganesh ,Ok..how was the network speed when it took long time comparatively to 2 mins time?

and as mentioned when it took long time any other jobs are executing compare  to 2 mins run?

[Rajkumar_J]

--Network speed is same as normal run.
--Yeah, at the same time i have tried to run another job as well. It got completed within 2 mins for 5 lakhs record

[manodwhb]

@uganesh ,when it was taking long time,is it takes time to fetch data?

[Rajkumar_J]

Yeah, it if fetching and processing the data at '12 rows/sec' or '5 rows/sec'

[manodwhb]

@uganesh ,can you analyse source statistics when that job was running long time and less time?

[Anonymous]

Hi, 

Q1) How many components you are having inside the talend job.

Q2) How many sub jobs are inside your main job

Q3) what are the sources, targets and lookups used and their types

Use TJava to print system time after each and every component. And share the log of execution  to analyze further.

[Rajkumar_J]

-- I have used only 3 components
-- There is no sub jobs inside my main job.
-- Source - SQl and target also SQL, no lookups have been used.