Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Incremental Load of Txt file!

Hi Qlik Community,

I have a folder which contains text files. Every week a new text file comes up.

As of now, the QVD builder fetches data from all the files from that folder.

I am thinking to do incremental load as I am concerned with the new file which comes every week. Other files are not at all touched.

As of now the script is;

Load

A,

B,

C, ....upto 22 fields

Left(Subfield(Filename(),' - ',2),10) AS WeekCommencing

FROM [lib://01_Firm_MI/Data Inputs & Outputs\People - Headcount\Input\*.txt]

(txt, codepage is 1252, embedded labels, delimiter is '|', msq, header is 1 lines);

Can anyone help me how do I get an incremental load done here?

Thanks

Amijit

2 Replies
arvind_patil
Partner - Specialist III
Partner - Specialist III

HI Amijit,

Please  Find below therad as well as steps given :

  1. Make sure that vLoadPeriod is numerical and > 0
  2. From Excel, load all rows WHERE Date >= AddMonths(MonthStart(Today()),1-vLoadPeriod)
  3. From QVD, add all rows that WHERE Not Exists(Date)
  4. Store the resident table into the existing QVD

Incremental reload and store into QVD file

Thanks,

Arvind Patil

rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

For text files, incremental reload is incredibly simple. Just add the "BUFFER (incremental)" prefix to the LOAD statement. That's all it takes.

-Rob

http://masterssummit.com

http://qlikviewcookbook.com