Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Mastering Change Data Capture: Read Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Job performance

Hello !
I have a job that retrieves the information from tables, passes it to a tMap and stores it in another table. The problem is that I end up with 45 lines per second. The job is slow ... and I do not think it's normal.
My database is on the network and my table has 900000 lines.
Could you help me please ?

0683p000009M4jb.png

Labels (2)
1 Solution

Accepted Solutions
vapukov
Master II
Master II

Thank you,

 

first what you need to test - checkbox "Use Batch", test with 10000, little more but not then 20000

 

View solution in original post

7 Replies
manodwhb
Champion II
Champion II

@Guen , You need to identify where the problem is.

 

As per your job you can do there things that

1) re-writing the query to improve the performance in tOracleInput

2) do the tMap operations on store on disk there you need to specify the temp location

3) use the tOracleOutputBulkExe component.

vapukov
Master II
Master II

Hi

 

what settings do you use for output component?

Anonymous
Not applicable
Author

Hello @vapukov 


Here are the simple settings and advanced settings that I use in my output component.

0683p000009M4jl.png0683p000009M4jq.png

vapukov
Master II
Master II

Thank you,

 

first what you need to test - checkbox "Use Batch", test with 10000, little more but not then 20000

 

Anonymous
Not applicable
Author

Great @vapukov ! when I checked "Use Batch" "and tested with 10000, the flow went to 330 lines per second. Should I increase it to have more lines per second?

vapukov
Master II
Master II

you can test add or reduce

 

total speed depends from server settings, for example insert could be faster, but commit longer

Anonymous
Not applicable
Author

Thank you verry much @vapukov