Rest connector to RSS feed

[manojciti]

HI All,

Appreciate if some one can help with connection to RSS feed using rest connector in QLIKSENSE to below link. 

https://news.google.com/rss/search?q=qlik&hl=en-US&gl=US&ceid=US:en

i tried but its giving error to check connection parameter. am i missing any steps or doing something wrong as i simply put url as above and connected using Windows Login credential.

Qlik REST Connector  Qlik Sense Enterprise on Windows   @mountaindude   @Sonja_Bauernfeind @stevedark 

[stevedark]

Hi @manojciti 

No Windows Login Credential required.

In Sense Desktop I just pasted in that URL and clicked Test Connection and it worked. I then renamed the connection and created it and was able to pull the list of articles.

You may want to take a look at this article at pulling data from RSS:

https://www.quickintelligence.co.uk/reading-rss-feeds-with-qlik-rest-connector/

There is also a link at the bottom of the post to an app you can download to view data once you have loaded it.

Hope that helps,

Steve

[manojciti]

HI Steve,

Thanks for your reply. Actually I'm trying to connect from Qlik Sense enterprise Feb 22 and not desktop.

simply putting url and clicking test connection and getting this error

Is there any setting I need to configure in QMC for allowing internet website or something because I'm unable to connect any  external website using REST connector but able to connect internal SharePoint URLs n all.

Thanks in Advance 🙂

[stevedark]

Hi again,

Hope you don't mind, but I was interested in seeing what I could do with the feed, so have tidied up the load a bit.

I have a REST connector setup called GenericGET, which just points to https://jsonplaceholder.typicode.com/posts, and then I use WITH CONNECTION to inject the URL. This means the search can come from a variable.

You could then put in a loop to do many different searches and concatenate the results (you would need to remember the mapping table would have IDs from 1 each time round the loop though.

Here's the code:

let vSearch = 'Qlik';

LIB CONNECT TO 'GenericGET';

RestConnectorMasterTable:
SQL SELECT 
	"__KEY_rss",
	(SELECT 
		(SELECT 
			"title",
			"link",
			"pubDate",
			"description",
			"__KEY_item",
			"__FK_item",
			(SELECT 
			FROM "guid"),
			(SELECT 
				"attr:url" AS "url",
				"@Content" AS "@Content_u0",
				"__FK_source"
			FROM "source" FK "__FK_source" ContentFieldAlias "@Content_u0")
		FROM "item" PK "__KEY_item" FK "__FK_item")
	FROM "channel" PK "__KEY_channel" FK "__FK_channel")
FROM XML "rss" PK "__KEY_rss"
WITH CONNECTION
(URL "https://news.google.com/rss/search?q=$(vSearch)&hl=en-US&gl=US&ceid=US:en");

Map_URL:
MAPPING LOAD	
	[__FK_source],
	[url]
RESIDENT RestConnectorMasterTable
WHERE NOT IsNull([__FK_source]);


Articles:
LOAD
	*,
    Date(DayStart([Date Time]), 'DD MMM YYYY') 	as Date,
    Time(Round(
    	[Date Time] - floor([Date Time]), 1/1440),
        							'hh:mm')	as Time,
    Date(MonthStart([Date Time]), 'MMM YYYY') 	as Month,
    Month([Date Time])							as [Month Name],
    WeekDay([Date Time])						as [Week Day],
    Hour([Date Time])							as Hour
    ;
LOAD	
    [title]								as Title,
	[link]								as Link,
	Date(Date#(mid([pubDate], 6, 20),
    		'DD MMM YYYY hh:mm:ss'),
    		'DD MMM YYYY hh:mm:ss')		as [Date Time],
	[description]						as Description,
	ApplyMap('Map_URL', [__KEY_item], 'Not Known') as [Source URL]
RESIDENT RestConnectorMasterTable
WHERE NOT IsNull([__FK_item]);

DROP TABLE RestConnectorMasterTable;

Steve

[manojciti]

Thanks Steve,

I'm trying your steps in document shared but I'm not able to create GENERICGET & giving below error.

[stevedark]

Hi @manojciti 

This is sounding more like it is a problem with the firewall from your Qlik Sense server than a problem with the RSS connector. The connectors in Desktop and Client-Managed are practically identical, so I don't think this is relevant to your problem.

When the RSS connector pulls data it does so from the server machine, rather than the client machine making the call.

Are you able to connect to the Sense server using Remote Desktop and try the URL in a browser?

If you can, and that fails, then it is almost certainly a firewall issue and you will need to ask your IT team to allow an exception through the firewall.

Steve

[manojciti]

Hi Steve, 

Really appreciate your quick response.. I tired using RDC and pasting URL in Browser and getting below message.

So I need to ask IT team to allow server access to https://news.google.com/. Hope I'm correct and then it will automatically allow me to pull data from

https://news.google.com/rss/search?q=qlik

https://news.google.com/rss/search?q=JPM

https://news.google.com/rss/search?q=Fintech

etc.

[stevedark]

Hi @manojciti 

I think our messages may be crossing a little. The issue with connecting to the placeholder is going to be the same as the one stopping you getting to the news feed.

Again, if you RDP to the Sense server I think you will find that you can not browse to that URL.

If IT only want to allow specific domains through the firewall have them whitelist news.google.com and then use this as the placeholder:

https://news.google.com/rss/search?q=placeholder&hl=en-GB&gl=GB&ceid=GB:en

This will still then allow you to inject searches from the variable.

Steve

[cmadeley]

Hello, I was following the procedure from the blog you suggested but on default settings it keeps throwing "connection closed prematurely"

Do I need to reconfigure anything or do I need to hit up IT to allow a connection? version is QlikSense February 2021 patch 11, rest version is Qlik REST Connector 2.63.2

Thank you

[stevedark]

Hi @cmadeley 

It is possible that IT need to open something in the firewall settings for you. If you are able to remote desktop to the Sense server and try the URL in a browser that may help prove this. Also try copying and pasting the URL into your own browser to see if that behaves differently. 

You don't need to use the placeholder URL, so if there is an endpoint that is reachable (perhaps news.google.com/rss) then just use that instead. 

Good luck, and please share how you get on. 

Cheers, 

Steve