topic Re: Are there limits with intervalmatch? in QlikView

Are there limits with intervalmatch?

Anonymous — Tue, 04 Feb 2014 10:28:54 GMT

I would think the answer is no but here is my problem.

I am working with a single days worth of call records and my load script with intervalmatch is working just fine. When I run the script for 6 months worth of data, 30+ million records, the same data I validated before that worked no longer does.

So are there limits interval match?

Thank you.

Re: Are there limits with intervalmatch?

hic — Tue, 04 Feb 2014 10:32:50 GMT

There are no "hard" limits. But you may run into memory problems if you have large data sets. Sometimes a While loop is a better option (uses less memory) than an IntervalMatch. See http://community.qlik.com/blogs/qlikviewdesignblog/2013/02/12/reference-dates

HIC

Re: Are there limits with intervalmatch?

Anonymous — Wed, 05 Feb 2014 01:11:17 GMT

Henric,

Thank you very much. I didn't go the way of the article you linked but did reference your article IntervalMatch and Slowly Changing Dimensions

The memory problem got me thinking and I remembered your part about

"The Autonumber() function converts the string to an integer that takes a lot less memory space."

The use of AutoNumber(AgentID & ' | ' & Num(StartDateTime) & ' | ' & Num(EndDateTime)) as [AgentID+Interval] really helped speed things up and use less memory. It made me also think of other areas I could save on memory consumption earlier in the load script.

Thanks

But now you spawned a new question I will open a new post on in regards to intervalmatch and incremental loads.