Qlik Community

New to Qlik Sense

Discussion board where members can get started with Qlik Sense.

Highlighted
Not applicable

Incremental Load of Txt file!

Hi Qlik Community,

I have a folder which contains text files. Every week a new text file comes up.

As of now, the QVD builder fetches data from all the files from that folder.

I am thinking to do incremental load as I am concerned with the new file which comes every week. Other files are not at all touched.

As of now the script is;

Load

A,

B,

C, ....upto 22 fields

Left(Subfield(Filename(),' - ',2),10) AS WeekCommencing

FROM [lib://01_Firm_MI/Data Inputs & Outputs\People - Headcount\Input\*.txt]

(txt, codepage is 1252, embedded labels, delimiter is '|', msq, header is 1 lines);

Can anyone help me how do I get an incremental load done here?

Thanks

Amijit

2 Replies
Partner
Partner

Re: Incremental Load of Txt file!

HI Amijit,

Please  Find below therad as well as steps given :

  1. Make sure that vLoadPeriod is numerical and > 0
  2. From Excel, load all rows WHERE Date >= AddMonths(MonthStart(Today()),1-vLoadPeriod)
  3. From QVD, add all rows that WHERE Not Exists(Date)
  4. Store the resident table into the existing QVD

Incremental reload and store into QVD file

Thanks,

Arvind Patil

MVP & Luminary
MVP & Luminary

Re: Incremental Load of Txt file!

For text files, incremental reload is incredibly simple. Just add the "BUFFER (incremental)" prefix to the LOAD statement. That's all it takes.

-Rob

http://masterssummit.com

http://qlikviewcookbook.com