Qlik Community

New to QlikView

Discussion board where members can get started with QlikView.

Partner
Partner

Twitter QV Source Loading ALL Tweet Data

Hi All,

I have been playing with QV source over the last few days in order to load twitter Data for a user..loading the latest 3200 lines / tweets is fine... but what about loading data before those tweets..lets say you have 70k tweets and you want to load that information too.

Setting up a load to look at the latest tweet and only pull data in front of that has been fine, but how do i rework this to look for the last tweet and load backwards...or do i even ignore that and do this differently?

any tips would be really helpful

Tags (2)
5 Replies
Highlighted
chrisbrain
Valued Contributor

Re: Twitter QV Source Loading ALL Tweet Data

Are you looking to load tweets that go further back based on a search query? I dont believe this is really possible using the Twitter REST api which QVSource is using,users generally build their own history by accumulating new Tweets i to a QVD file.

Partner
Partner

Re: Twitter QV Source Loading ALL Tweet Data

correct, i'm looking to load tweets that go all the way back to the users first tweet. I'm adding new tweet data onto my existing QVD daily, but to pull some meaningful statistics id ideally need the users complete history. I've found very little on the subject online but i'm sure it must have been done already

praveenavelagap
Contributor III

Re: Twitter QV Source Loading ALL Tweet Data

How are you storing previous data?Is it just concatenate to old QVD? Can you please guide me on this.

chrisbrain
Valued Contributor

Re: Twitter QV Source Loading ALL Tweet Data

Yes that is right, concatenate into old QVD.

We have a pretty advanced demo app on our GutHub site:

https://github.com/QVSource/

Which does just this:

https://github.com/QVSource/QVSource-Twitter-Starter-App-For-QlikView

Please note though that we do not give support on actual QlikView/Qlik Sense application developments, these apps are given away freely to help users get started.

reddys310
Honored Contributor II

Re: Twitter QV Source Loading ALL Tweet Data

Hi Craig,

I would suggest you to use the Twitter API access, fetch the data using R, convert it into a Data frame and then save it as a CSV. This converted CSV file can then be used for further analysis in QlikView or QlikSense.

Hope this helps.

- Sangram