Hi community,
We have several processes in Production which distribute and send a large amount of emails (>1.000).
As of late, the amount of emails to send has grown to 7K or more. Currently we split all the emails into four documents distributing in parallel, resulting in less than 2.000 emails per doc.
Even after splitting them, the process took too long, more than 24 hours, and the task stopped because of the default Timeout of the own task itself was reached (in Trigger task > Task execution options > Timeout in minutes is set to 1440 by default).
The log file is reporting this error is as follows:
24/01/2013 16:53:29.0966360 Information Executing ClusterID=1, QDSID=92f16de7-9f6e-1c1d-d356-47547a783d5c QDSMain.DistributeTask
24/01/2013 16:53:29.0966360 Information Starting task "SMP Send PDF documents: Sending 02" (Attempt 1 of 1)
24/01/2013 16:53:29.0966360 Information Max run time: 1.00:00:00
24/01/2013 16:53:29.0966360 Information Distributing document.
[...]
25/01/2013 16:51:57.9767299 Information ROUND: 1141 of 1643.(Remaining: 16h 48m 0s). WarningCount=0
25/01/2013 16:53:39.7625143 Information Closing the document.
25/01/2013 16:53:39.9655860 Information TRACE:Thread finished. Name=XSTP Worker thread 16, Status=Success
25/01/2013 16:53:39.9655860 Information Closed the QlikView Engine successfully. ProcessID=1288
25/01/2013 16:53:39.9655860 Information Initializing (0), Finished (219)
25/01/2013 16:54:40.1372928 Error Task aborted.
25/01/2013 16:54:40.2153973 Error The task "SMP Send PDF documents: Sending 02" failed. ErrorCount=1
25/01/2013 16:54:40.2153973 Information TRACE:Got TaskMessage: SMP Send PDF documents: Sending 02: FinishedWithErrors
We tried to increase this timeout to double (2880 minutes), but when the task starts again, we get the same info message:
2/11/2013 10:32:34.5897334 Information Max run time: 1.00:00:00
when we were expecting Max run time 2.00:00:00
Is 24 hours the max run time possible?
Thanks in advance!
Some info of interest:
QlikView Publisher is in a 128 GB server with 16 CPU cores - can't be upgraded because of budget reasons.
Hyperthreading in the server has been disabled - which boosted the number of emails sent per minute.
QlikView is v9.0 SR7 - can't be upgraded to v10 or v11 because of budget reasons.
Max number of simultaneous QlikView engines for distribution is set to 4.
With 4 docs sending emails in parallel, CPU is around 50% and Memory usage is low (less than 20%). We could keep splitting emails in more documents (e.g. 8, 16...) but anyhow at some point the number of emails could be larger than 2.000 * (number of documents in parallel)
