Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Not applicable
‎2012-03-14 09:52 AM

Incremental load

Hi,

Anybody can help me on this issue..

I've been working on it for over three weeks!!

I am loading phone log files"TXT" from a directory and the directory receives new log files every few minutes... and it is a hug directory"it takes over 8 hours to finish loading".

Is there anybody can help me in setting incremental load so I dont load all the files again.

It will be great if i can load to a QVD file and have the incremental load to there and then I can load from the qvd to my application.

Attached is the QVW and a sample of the directory.

Thanks

log files test.zip
LogFiles Valdate.zip
6,477 Views
0 Likes
21 Replies
swuehl
MVP
MVP
‎2012-03-26 11:35 AM

In response to

Badr,

the script looks fine at first glance.

From the LogLineEntry field of the qvw file you attached above, the vMaxSeq value is 558266.

Hence only logfiles with a sequence number larger than 558266 will be added.

Can you confirm that your logfiles you try to add have seq numbers larger than 558266. If so, yould you upload some of them in a zipped file?

222 Views
0 Likes
Not applicable
‎2012-03-26 11:55 AM
Author

In response to swuehl

Yep it is..

Sorry, I should've replayed that it is fine.

the only thing I had to do is delete the QVD file and clear up the data from the report and then reload everything.

so far everything work perfectly.

Thank you so much

Badr

222 Views
0 Likes