topic Re: Google Scholar Connector in QlikView

Google Scholar Connector

karthikeyan1504 — Thu, 22 Oct 2015 06:52:11 GMT

Hi Everyone,

I want to fetch the data from google scholar.

Could you please advise me how to do it? Is there any document available?

I have downloaded the list of connectors from qvsource. but I couldn't fine the connector for google scholar.

Please advise!!!

Thanks in advance

Regards,

Karthikeyan.

Re: Google Scholar Connector

Peter_Cammaert — Thu, 22 Oct 2015 07:56:20 GMT

Where did you get this idea that QVSource already offers a connector for Google Scholar?

Re: Google Scholar Connector

karthikeyan1504 — Thu, 22 Oct 2015 08:00:01 GMT

Hi Peter,

I just checked in qvsource.

Please advise me if there is any way to connect to google scholar.

Thanks

Karthikeyan.

Re: Google Scholar Connector

Peter_Cammaert — Thu, 22 Oct 2015 08:11:39 GMT

I guess not.

But IMHO, QVSource allows you to create your own connectors.

Re: Google Scholar Connector

karthikeyan1504 — Fri, 23 Oct 2015 01:56:08 GMT

Hi all,

Any one have an idea?

Thanks & Regards,

Karthikeyan.

Re: Google Scholar Connector

karthikeyan1504 — Fri, 20 Nov 2015 02:49:01 GMT

Hi everyone,

I could get the data directly from the google scholar page source in qlikview without using any API.

But any of you aware whether fetching the data in this way is legal?

Thanks & Regards,

Karthikeyan.

Re: Google Scholar Connector

karthikeyan1504 — Wed, 25 Nov 2015 01:43:30 GMT

Still looking for a solution!!! please...

Re: Google Scholar Connector

petter — Thu, 26 Nov 2015 16:34:24 GMT

Well there is no API available from Google for Google Scholar. That means that the only approach to get data out of it is by web-scraping. That can be a very tedious and time-consuming and possibly a very unreliable process. But there are already Python scripts available to do exactly this. One could also use something like PhantomJS or pjscrape or something similar to fetch data to be relieved of the huge effort to write it yourself.

Then you would run some scripts before you run your load script and then read the retrieved file(s) from your load script. Basically not using a connector approach.

Re: Google Scholar Connector

karthikeyan1504 — Fri, 27 Nov 2015 01:21:17 GMT

Hi Petter,

Thank you so much for your response.

Is it legal to fetch the data from google scholar through web scrapping method?

Warm Regards,

Karthikeyan.