Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
craig_adams
Partner - Contributor II
Partner - Contributor II

Twitter QV Source Loading ALL Tweet Data

Hi All,

I have been playing with QV source over the last few days in order to load twitter Data for a user..loading the latest 3200 lines / tweets is fine... but what about loading data before those tweets..lets say you have 70k tweets and you want to load that information too.

Setting up a load to look at the latest tweet and only pull data in front of that has been fine, but how do i rework this to look for the last tweet and load backwards...or do i even ignore that and do this differently?

any tips would be really helpful

5 Replies
chrisbrain
Partner - Specialist II
Partner - Specialist II

Are you looking to load tweets that go further back based on a search query? I dont believe this is really possible using the Twitter REST api which QVSource is using,users generally build their own history by accumulating new Tweets i to a QVD file.

beeido.com - BI | Software | Qlik Integration Services
GitFirst - A CI/CD solution for Qlik Sense
craig_adams
Partner - Contributor II
Partner - Contributor II
Author

correct, i'm looking to load tweets that go all the way back to the users first tweet. I'm adding new tweet data onto my existing QVD daily, but to pull some meaningful statistics id ideally need the users complete history. I've found very little on the subject online but i'm sure it must have been done already

Anonymous
Not applicable

How are you storing previous data?Is it just concatenate to old QVD? Can you please guide me on this.

chrisbrain
Partner - Specialist II
Partner - Specialist II

Yes that is right, concatenate into old QVD.

We have a pretty advanced demo app on our GutHub site:

https://github.com/QVSource/

Which does just this:

https://github.com/QVSource/QVSource-Twitter-Starter-App-For-QlikView

Please note though that we do not give support on actual QlikView/Qlik Sense application developments, these apps are given away freely to help users get started.

beeido.com - BI | Software | Qlik Integration Services
GitFirst - A CI/CD solution for Qlik Sense
reddy-s
Master II
Master II

Hi Craig,

I would suggest you to use the Twitter API access, fetch the data using R, convert it into a Data frame and then save it as a CSV. This converted CSV file can then be used for further analysis in QlikView or QlikSense.

Hope this helps.

- Sangram