Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik GA: Multivariate Time Series in Qlik Predict: Get Details
cancel
Showing results for 
Search instead for 
Did you mean: 
d_koti24
Creator II
Creator II

INCREMENTAL LOAD

I WANT KNOW ABOUT THE INCREMENTAL LOAD

11 Replies
d_koti24
Creator II
Creator II
Author

thank u boss............

Anonymous
Not applicable

Hi

Rather than using incremental loads you could write a server side script to pull your data from the DB and save as a CSV file, incremental loads can become slow the bigger the table.

A summary for you

  1. Server side script pulls data from DB and saves as CSV files.
  2. QVW file loops over CSVs and creates a mirror QVD file.
  3. All of you reports can pull in the QVDs - LOAD * FROM myUsersCsv_*.qvd (qvd);

An example of speed savings:

  • To rebuild a 35M row x 40 Column User db table into QV via incremental loads - total build 3.5 hours
  • To rebuild same table into CSV 8 mins, then point 2 of summary 10 mins. - total build 18 minutes

I've written about it in more detail:

http://community.qlik.com/message/596536

Remeber "Incremental loads are dead, long live the CSV"