Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Join us at Qlik Connect for 3 magical days of learning, networking,and inspiration! REGISTER TODAY and save!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Not applicable
‎2015-02-12 12:11 AM

Big Data Text problem: Can I create a QVD behind the scenes with match() result?

I have 6+ million rows of text data (5+ GB) and I am matching the data with multiple key words. It is looks great in the dashboard. But switching key words in the dashboard causing performance issues due to size of the text.

The question is can I extract match results to QVD? By that my end users just use that QVD dashboard instead of maneuvering 6+ million rows every click?

327 Views
0 Likes
1 Reply
marcus_sommer
MVP
MVP
‎2015-02-12 10:31 AM

String comparison would be always (very) slow. Therefore it's better to use numeric-matches in this way that you creates multiple normal flag-fields which contain 0 or 1 and/or combined flag-fields which contain unique sums for certain matchings - maybe you could find here some hints: http://community.qlik.com/search.jspa?q=multiple+flag.

Also could it be helpful if you could restrict the calculation with additional filters to certain areas or periods or similar - maybe per set analysis expression.

- Marcus

236 Views