Twitter feed in QlikView (without 3rd party tooling)

[#1]

 Hi,

I was looking for ways to connect QlikView to twitter and load/analyze the results of a search term. Thanks to this community I came accross 3rd party tools, like QVSource, but today I noticed it is also possible to do it without a 3rd party tooling so I thought it would be nice to share that.

It is possible to use the Twitter REST API - GET search to return tweets that match a specified query. The return formats are JSON and ATOM. To my knowledge it is not possible to load the JSON format into QlikView, but the ATOM format is basically XML so that one can be used.

For example, you can use the URL below as a Web File source in QlikView. It returns tweets that match the search term "Qlikview". The result returns several tables, but the +feed/entry +table is in my opinion the most interesting one containing user, language, geo, source, date, message information. The returned fields are not as extensive as in QVSource, but at least it is something to get started with.

Also the results are* limited to 100 tweets *so a scheduled document refresh should be done very often and for search terms which generates lots of fast changing results, like trending topics, it is not a workable solution, but for all others it could be just fine.

URL: http://search.twitter.com/search.atom?q=Qlikview&rpp=100&include_entities=true&result_ty...
For more parameters see the REST API - GET search page: https://dev.twitter.com/docs/api/1/get/search

Twitter's REST API page: https://dev.twitter.com/docs/api </p>

[#2]

Thanks Bjorn!

[#3]

Hi Björn

Have you manage to get the twetts with the new API?

[#4]

Hey Nacifu,

Unfortunately the new twitter API, returns the result in JSON format, and QlikView is unable to return interpret JSON at the moment.

This would be a excellent implementation in the next release though (",).

[#5]

You could develop a application and service to retrieve, collect, collate, and convert the data for QlikView to read.

However I feel the process of developing a application to mine twitter data for a task that many developers face, abit tedious, since the resulted outcomes are the same or similar, when the same application/code could shared.

I have created a alternative application written in ASP.NET web forms using C# with the twitterizer in order retrieve the data i required.

I've not yet made the web application available to public, as i'm still working on adding more functionality for mining retweeter information and geo-location data.

I'll upload the web application (with the current functionality) to a server within the week and host it online, for manual use; and with the source code for reuse in a windows service, for automated tasks... the windows service code will be uploaded too... I'll post the site URL on this thread when complete.

The app currently reads the JSON responses from the API, and only outputs the results in xml files.

The current functionalities are to retrieve tweets of one/many tweeters, retrieve lists of followers for each tweeter, retrieve profile information for all lists of followers.