Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik and ServiceNow Partner to Bring Trusted Enterprise Context into AI-Powered Workflows. Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
gcurato82
Partner - Contributor II
Partner - Contributor II

slow job scheduled windows task

hello everyone, I use Talend open studio 7.3.1 and 

I have a problem with my work when it is scheduled with a windows task, because this is slow and takes a long time to run, while if I run it directly from Talend, the work is fast.

the ETL provides a tDBInput object -> tDBOutput, (database postgres) in the input the query retrieves 190 fields and there are 2 joins, are moved less than 400k records.

Does anyone have suggestions on how to fix my problem? 

Labels (3)
15 Replies
Anonymous
Not applicable

This is strange. I would expect the precompiled job to run A LOT faster (as it doesn't have to go through the process of compilation first). Two reasons I can think of that might impact performance (off the top of my head) are....

 

  1. You have scheduled the job to run during particularly busy times for your DBs
  2. You are running it on a different machine with different resources or different network capabilities

 

gcurato82
Partner - Contributor II
Partner - Contributor II
Author

thanks for giving me an answer. the server on which I ran the job, in the two modes, is the same only at different times, at a distance of a few minutes between them. As for the database load, there was no stress at that time. this Job is also scheduled during the night time slot (03:00 AM), and the result is always the same, it takes about 3h.

gjeremy1617088143

Hi, maybe you can improve the xms and xmx param in the .bat of the job.

also when you execute the .bat manualy do you have the same time ?

Send me love and kudos.

gcurato82
Partner - Contributor II
Partner - Contributor II
Author

hello, thanks for your reply. i had never tried to manually run the job using the file ". bat", I just made the attempt and the execution happened at the same time as when I launch it from Talend console. what can this mean? 

gjeremy1617088143

and your scheduled windows task execute this .bat ?

gcurato82
Partner - Contributor II
Partner - Contributor II
Author

you are executed by the windows task without errors, but very slow. 

The task runs only when previous tasks are successfully executed.

gjeremy1617088143

could you try to make a new scheduled task with this job , with no previous task needed to run , you schedule it in the next 5 minute and you'll see if the problem come from the job

gcurato82
Partner - Contributor II
Partner - Contributor II
Author

hello, I did the test you suggested and the job took a few minutes, as for the Talend console. 

so this means that the problem is the trigger with the other tasks? 

Anonymous
Not applicable

Following on from what @guenneguez jeremy​ said, maybe try adding some logging to the job (if you haven't already). Just something at the very start (using a tPreJob component) and something at the very end (using a tPostJob) component. From what you have both discussed, this looks like it might not be the job you suspect is slow causing the problems here.