topic getting data from web page with login in QlikView

getting data from web page with login

Thu, 30 Dec 2010 14:43:40 GMT

Hi,

Is there a way for QlikView to download data from webpage, that requires login first? If not maybe you know some methods for automating login to a webpage, then going to specific link and saving the webpage as html file on disk, which then could be read by QlikView?

Thanks in advance for help.

getting data from web page with login

Mon, 10 Jan 2011 10:27:30 GMT

Anyone know any solutions to this?

getting data from web page with login

Anonymous — Mon, 10 Jan 2011 10:35:52 GMT

hi ,

try for the option web files..

in edit script you can see web flles button.

give your url and check whether you can load the data from web page

regards,

sam

getting data from web page with login

Mon, 10 Jan 2011 11:23:33 GMT

I did this already. But you can't access the data in this url when you're not logged in first so it doesn't work. When you're not logged in this url just redirects you to login page, without displaing proper data.

getting data from web page with login

Mon, 10 Jan 2011 16:35:27 GMT

maybe possible to pass username and password through your load url ?

getting data from web page with login

Tue, 11 Jan 2011 10:17:19 GMT

There's no such possibility (even if there was, sending user/pass through url wouldn't be secure much). I guess there's no simple and secure solution for automizing this.

getting data from web page with login

Tue, 11 Jan 2011 10:26:23 GMT

There are command line tools such as curl or wget that are able to logon to a webpage and save it as a file. They work through proxies, can use plain text passwords, digest authentication, forms authentication, Windows Integrated Authentication , ftp upload /download, WebDAV (including SharePoint) upload/download ...

Have a batch file that saves the HTML file prior to reload.

-Alex

getting data from web page with login

Tue, 11 Jan 2011 10:48:31 GMT

Seems to be the solution, thank you Alexandru! I will read about them and try to use it.

One more question: is there a way to run external application (curl or wget) directly from QlikView? (i use personal edition for now)

getting data from web page with login

Wed, 13 Apr 2011 10:20:05 GMT

Hi tkossak1 ,

I have the similar requirement. Can u post an sample file . I havent used to the tools what has been mentioned in the solution.

getting data from web page with login

Fri, 15 Apr 2011 14:58:17 GMT

What sample file - wget bat? i used wget this way:

wget.exe --no-check-certificate -O d:\1.html ^ --save-cookies=d:\cookies.txt ^ --post-data="AccountName=your_login_here&Password=your_pass_here&action=doLogin&other_post_data_here" ^ https://your_link_here.com/

(i changed the link/login/pass) but i had problems with login through HTTPS and after few wrong tries it started to display captcha for me so i gave up. Anyway it downloaded normal (http) pages without any problems.

Jakob's solution looks very promising - i will try this VB script, it seems to handle HTTPS logins easier that wget.

Re: getting data from web page with login

qlikviewforum — Tue, 28 Aug 2012 06:19:51 GMT

I wan to achieve the same without using the thirdparty tool. Please let me know how that can be achieved!

Re: getting data from web page with login

qlikviewforum — Fri, 31 Aug 2012 12:18:45 GMT

Hi All,

I tried my level best but unfortunately couldn't able to succeed yet.

I read some where about QVSource. Is it possible to load the data from secured sharepoint site using the same? Any help please?

Thanks,

qlikviewforum

Re: getting data from web page with login

Tue, 04 Sep 2012 13:23:20 GMT

Hi,

Did you try passing creditentials in the url :

http://username:password@ website.com

Regards

Kevin

Re: getting data from web page with login

qlikviewforum — Tue, 04 Sep 2012 13:39:29 GMT

thanks! Yes I have tried but it didn't work!

Re: getting data from web page with login

chrisbrain — Fri, 12 Oct 2012 10:25:51 GMT

Many web sites will set a cookie once you have successfully authenticated which when sent with future requests will allow you access the secured page.

Our QVSource general web connector now allows you to send a cookie with the request which should in many/most cases allow you to access such secured page:

http://www.qvsource.com/wiki/General-Web-Connector-For-QlikView.ashx

Re: getting data from web page with login

JimKnopf666 — Thu, 18 Apr 2019 11:05:17 GMT

Ups ... seems not to be working. Can you please repost the URL. Thanks a lot

http://www.qvsource.com/wiki/General-Web-Connector-For-QlikView.ashx