-
Re: Querying dataset in qlik
Andy Weir May 2, 2017 5:00 PM (in response to Tom Watson)Would be good if you posted a small subset of your data to illustrate your question.
Qlik will certainly handle your data volume and as long as you can associate the data in your 50k dataset with your 1m data set with a key then you can display your data in many chart types not just a list box.
-
Re: Querying dataset in qlik
Rob Wunderlich May 2, 2017 5:20 PM (in response to Tom Watson)Is this an on-demand kind of thing? That is, do you need to be able to generate the 50k list and quickly apply the filter in Qlik Sense? Or is this more like a daily process that builds the 50k list that can be loaded by the QS load script?
-Rob
-
Re: Querying dataset in qlik
Tom Watson May 3, 2017 8:35 AM (in response to Tom Watson)let me give a little more detail. Let's say it's auto insurance, and I have a list of 1 million auto policies, but I only want to see the data in qlik for those autos who have had 2 accidents. I run a query in access with my original data and find that only 50,000 of those million have had 2 accidents.
So now I want to go into qlik and be able to filter on those 50,000 policies. Is there a way to do this?
-
Re: Querying dataset in qlik
Josh Good May 3, 2017 4:01 PM (in response to Tom Watson)Hi Tom,
With Qlik, generally speaking, you will load all your data in and then filter from there. This gives you much faster filtering and also makes it possible to leverage the associative model (see: this video for a quick overview).
For your case what you can do is load all million policies with the accident information Then create a visualization (bar chart, listbox, pivot table etc.) that shows the number of accidents. Every visualization is interactive so you can select on everything with 2 accidents.
With Qlik, the process is:
1. Load the data you are interested in analysing
2. Create some visualizations
3. Filter and select to do do the analysis.
By using this approach vs pre-filtering your data, your Qlik app will be able to answer many more questions quickly vs just answer one question at a time.
-Josh
Qlik
-
Re: Querying dataset in qlik
Tom Watson May 3, 2017 4:05 PM (in response to Josh Good )Josh thanks for your answer, but what if my data in qlik does not have number of accidents? I do not load the data in qlik, I do not have those capabilities, I use a table that is published for me.
-
Re: Querying dataset in qlik
Josh Good May 3, 2017 4:31 PM (in response to Tom Watson)Hi Tom,
If your data doesn't have the number of accidents then how can you get to the data with only two accidents? Can you provide an example show the data you have (even a simple mock up of a few lines)?
-Josh
Qlik
-
Re: Querying dataset in qlik
Rob Wunderlich May 3, 2017 7:44 PM (in response to Tom Watson)I'm with Josh that it would be great to do this in QlikView. But also understand that you don't have the filtering criteria available in QV and you can't modify it. If that's absolutely the case, you can select multiple values in a Listbox with a argument in this syntax:
(2|5|10)
where 2,5,&10 are the values you want to select. So if you can output the format of your access query output in this format, you may be able to paste it to the listbox and select all 50k values. I say "may" because I've never tried it with a list that large and I wouldn't be surprised if there were problems.
I encourage you to pursue getting the additional data -- such as accidents -- into QV if at all possible. Can you post your current data model? (Ctrl-t and then export the image)
-Rob
-
-
-