I currently have an automated task setup in Nprinting that generates excel files. Each file is approximately 50kb so relatively small. The task is run everyday with a number of excel files generated. I've noticed that when generating 340 files it takes approximately 40 minutes (8.5 files / minute) and other runs I've done so that this figure of 8.5 files per minute to be consistent. The concern/question is that on any given day in the year it is required that 50,000 files are automatically generated and if we go on the basis that 8.5 files are generated per minute this would take approximately 98 hours to complete which off course cannot be done within a day.
What options are there to generate 50,000 files within a day in Nprinting?
Hi. Generating this amount of reports requires proper planning:
planning environments both Qlik Sense and Nprinting. Performance is highly dependant on Qlik Sense performance
Building optimal Qlik Sense app. The usual lazy approach is to put together app which is not optimal and does not perform well-there are ways of developing apps so they work well
hardware-you have not mentioned anything about your server specs
report template-construction pf the template can greatly influence report generation time
in a nutshell there is so many variables causing such and such report generation time that your assumption based on just current time required to generate report is too vague. You need to look at the whole thing and troubleshoot where are bottlenecks . cheers
cheers Lech, When applicable please mark the correct/appropriate replies as "solution" (you can mark up to 3 "solutions". Please LIKE threads if the provided solution is helpful to the problem.
In addition to @Lech_Miszkiewicz excellent points, all of which are critically important to a smoothly operating environment, you may wish to add more engines to have the ability to spread the load of the work and enable additional more threads to work on your publish task executions.
The executions can be viewed/observed from the hidden admin/plan feature.
Note that this tool was developed by R&D for R&D so not specifically very intuitive. But you can use the link above to understand the basics.
Suggest that you work with a Trusted Qlik Partner or Qlik Professional Services to build an implementation plan through iterative requirements gathering to evaluate and find the optimal overall solution from the architecture of your Apps, Reports, day to day Pprinting and Qlik Sense/Qlikview overall usage to your Hardware Environment and more.
Kind regards...
Please remember hit the 'Like' button and for helpful answers and resolutions, click on the 'Accept As Solution' button. Cheers!
