topic Re: connection qlik sense to twitter in Connectivity & Data Prep

connection qlik sense to twitter

Anonymous — Fri, 02 Apr 2021 08:07:01 GMT

Hi community

I want to connect to my twitter account with qlik sense; I followed the steps to fill in all the identifiers; I created a connection with REST connector; I filled in all the fields but when I test the connection; it does not work . I have an error

Re: connection qlik sense to twitter

stevedark — Fri, 03 Nov 2017 08:09:12 GMT

HI Mariam,

I think you may need to remove the quotes from your Authorisation header, take out both instances of "

Hope that works for you,

Steve

Re: connection qlik sense to twitter

Anonymous — Fri, 03 Nov 2017 10:45:36 GMT

Thank you for your feedback sir ; but i don't get your point ;more details plz

Re: connection qlik sense to twitter

stevedark — Fri, 03 Nov 2017 11:42:43 GMT

When I have an Authorization key it has the quotes shown as quotes, rather than URL encoded, as "

I use PostMan ( https://www.getpostman.com/ ) to generate the Authorization string and then paste it in.

Note that the start of the oauth_consumer_key is a " symbol.

Watch that the Authorization key changes with the slightest change to the end point. Even changing a search parameter or number of rows returned will change this.

Steve

Re: connection qlik sense to twitter

Anonymous — Fri, 03 Nov 2017 12:01:20 GMT

It works thank you

Re: connection qlik sense to twitter

stevedark — Thu, 16 Nov 2017 08:17:38 GMT

HI Mariam,

You may also like to look at this blog post by catalystmichael‌ which talks about the Spotify API. It's a different API, but the techniques are very similar:

https://adventuresinqlik.com/2017/11/12/spotify-rest-qlik/

Steve

Re: connection qlik sense to twitter

Anonymous — Fri, 16 Mar 2018 18:28:20 GMT

What else did you provide in Header : Authorization other than consumer key. Where can I refer to the document related to this?

Re: connection qlik sense to twitter

stevedark — Fri, 16 Mar 2018 20:11:47 GMT

Hi,

I'm hoping to polish my app, document it and upload it sometime soon. In the meantime here are some snippets from my load script that may help...

// To use this application you first need a valid Twitter acccount

// Log in to this and then go to https://apps.twitter.com and create a new API app

// Enter all the required information for a read only API application

// Go to the Keys and Application Keys tab and copy the Consumer Key and Secret into a new string separated by :

// Ensure that there are no rogue spaces or characters in this key

// Go to the site https://www.base64encode.org and paste your string in the top box

// Press the Encode button and a new string will be generated and appear in the bottom box

// Copy and pasted this string into the vBASE64 variable below

let vBASE64Key = 'xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx';

tmpBearerKey:

SQL SELECT

"tokem_type",

"access_token"

FROM JSON (wrap on) "root" PK "__KEY_root"

WITH CONNECTION (

URL "https://api.twitter.com/oauth2/token",

HTTPHEADER "content-type" "application/x-www-form-urlencoded",

HTTPHEADER "Authorization" "Basic $(vBASE64Key)",

QUERY "grant_type" "client_credentials"

)

;

let vBearerKey = peek('access_token', -1, 'tmpBearerKey');

DROP TABLE tmpBearerKey;

SELECT

...

FROM JSON (wrap off) "statuses" PK "__KEY_statuses"

WITH CONNECTION (

URL "https://api.twitter.com/1.1/search/tweets.json?q=%23$(vHashTag)&result_type=recent&count=200$(vMaxTweetURL)",

HTTPHEADER "Authorization" "Bearer $(vBearerKey)"

);

Steve

Re: connection qlik sense to twitter

rkondaveti — Wed, 02 May 2018 11:57:38 GMT

Hi Steve,

Did you get a chance to polish your app ? i am trying to extract data from Twitter but i struck at generating Oauth Signature and Oauth nonce. How did you generate them in your app ?

Cheers,

Raghav.

Re: connection qlik sense to twitter

stevedark — Wed, 02 May 2018 12:45:34 GMT

The Base64 key was created using an online Base 64 converter - is that what you are stuck at?

Another way of looking at Twitter in Sense is to sign up for a Cloud account at http://www.qlikcloud.com/ and then look in the Qlik Cloud Resources stream. There is a Twitter app you can copy and amend.

Hope that helps,

Steve

Re: connection qlik sense to twitter

rkondaveti — Thu, 03 May 2018 07:49:56 GMT

Hi Steve,

We are working on REST API Connector and Web connector

REST Connector :

I am able to pull followers data from Twitter using GET POSTMAN generated Authorization value, but it is gives me only 20 rows,using next cursor value i could get next batch of rows but oauth_signature and oauth_nonce need to be updated for each query to fetch more data however i struck at this point. i am not sure how to generate these values.

Tried your approach:

let vBASE64Key = 'xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx';

tmpBearerKey:

SQL SELECT

"tokem_type",

"access_token"

FROM JSON (wrap on) "root" PK "__KEY_root"

WITH CONNECTION (

URL "https://api.twitter.com/oauth2/token",

HTTPHEADER "content-type" "application/x-www-form-urlencoded",

HTTPHEADER "Authorization" "Basic $(vBASE64Key)",

QUERY "grant_type" "client_credentials"

)

;

let vBearerKey = peek('access_token', -1, 'tmpBearerKey');

DROP TABLE tmpBearerKey;

but it is throwing connection error.

Is there any way or script to generate unique values for these in a loop ?

WEB Connector:

it is fairly easy easy to pull the data using Twitter web connector. I could pull only 3000 row, not sure we could pull next set of data any idea on this ?

Cheers,

Raghav

Re: connection qlik sense to twitter

rkondaveti — Thu, 03 May 2018 09:48:48 GMT

Would like to implement this in Qlik

Creating a signature — Twitter Developers