Documents for QlikView related information.
Querying MongoDB directly with QlikView is pretty easy to set up. You don't need any 3rd party extensions. If anyone is interested in learning more about it you can take a look at a basic presentation that I put together.
Thanks and Regards
Could you tell us a bit more about the high volume performance ? What is your experience so far ?
I personally probably would not use it, and would use standard mongodb tools instead.
So I would use mongoexport utility to get csv file from mongodb, for example:
mongoexport --db scratch --collection zips --csv --fieldFile fields.txt --out c:\export\zip.csv
and then load that csv file to QlikView
For me it is preferable way because:
So on the whole in my opinion simple scheme with intermediate staging of data in csv file shoud be more robust and performant
Bertrand, I have not done an extensive amount of performance testing but one nice feature of the MongoDB REST interface is that you can parameterize your queries like this:
This way you can filter your data in MongoDB and only bring a smaller subset into Qlik.
Yea but CSV is probably not great if your data is hierarchical and you would like to preserve the relationships in Qlik.
But yea good points, I like your approach.
I would recommend looking at the Datascript Module available with QlikView Expressor:
olgaavram: Good point.
While one can easily flatten mongodb collection with embedded documents by mongoexport, flattening collection with embedded arrays require either mongodb aggregation framework (which is currently not supported by mongoexport) or scripting.
In that case I would use any available mongodb client (ruby in your case) to get flat csv data from mongodb.
I believe all efficiency and robustness considerations from my previous post (network utilization and so on) apply in that case too.
Additionally I suspect that writing in ruby aggregation framework's query or simple snippet with loop to get flat data from mongodb collection would be easier then to flatten deeply nested XML collection in QlikView script.
Obviously QlikView Expressor gives other options.
Well, thanks all. We finally used mongoexport tool which gives us a 3 huge csv (3 Go) but thank to Qlikview it was greatly compressed into a nice little qvd.
In fact, we didn't need to restrict the perimeter. We needed everything.
Thanks to all of you. Have a nice weekend.