topic how to pull data from URL which requires credentials in QlikView

how to pull data from URL which requires credentials

montubhardwaj — Thu, 02 Jun 2011 11:19:15 GMT

I am trying to fetch some information from one site (URL).Generally I have to logon with my credentials to view the information. When I tried to pull the information (using QV)from the site, it says as below:
"You are not authorized to view this page You do not have permission to view this directory or page"

I know that because it requires a USERID and PWD to get to the information. How can I get it done the same in QV?

how to pull data from URL which requires credentials

montubhardwaj — Thu, 02 Jun 2011 13:13:25 GMT

Can anyone guide me through ?

how to pull data from URL which requires credentials

erichshiino — Thu, 02 Jun 2011 13:17:38 GMT

Hi,

If the website works like this, you can try a syntax like this:

http(s)://username:password@server/resource.ext

how to pull data from URL which requires credentials

montubhardwaj — Fri, 03 Jun 2011 08:23:17 GMT

Thanks Erich.

To test this, I just tried to access my gmail but I was not successfull. I did input username and pwd. Am I making some mistake somewhere ?

how to pull data from URL which requires credentials

montubhardwaj — Mon, 06 Jun 2011 11:50:35 GMT

I have the access to the URL after entering my USER ID and Password. But I am not able to pull the information using QV. I tried the approach suggested by Erich but that too is not working. It says that "You are not authorized to view this page......."

I am not getting what is going on here.Using the same Id and Pwd, I can view the all the site contents but not by using QV.

how to pull data from URL which requires credentials

erichshiino — Tue, 07 Jun 2011 01:12:49 GMT

I guess it can depend on the website.

I saw on the internet that the syntax for gmail is:

https://www.google.com/accounts/ServiceLoginAuth?service=mail&Email=yourID&Passwd=yourPWD

I tried it with Qv but I didn't work for me. I got an error...

The website you are trying to read may also impact the results.

QV must identify tables in the source code it receives from the server...

how to pull data from URL which requires credentials

montubhardwaj — Tue, 07 Jun 2011 04:21:30 GMT

are there any settings in QV which we need to do to enable this content? Provided UserID and Pwd, QV must be able to log on..... any other work around for this ?

Re: how to pull data from URL which requires credentials

rwunderlich — Tue, 07 Jun 2011 05:34:39 GMT

Login flow varies by site and QV does not provide many options for handling login. You may want to try a command line tool like CURL http://curl.haxx.se/ that will let you script the http fetch into a flat file. And then have QV load the flat file.

-Rob

Re: how to pull data from URL which requires credentials

hectorgarcia — Tue, 21 Jun 2011 23:41:25 GMT

If you are not being successfull connecting directly QV to the website because of the credentials , let me sugest a workaround that is working for me.

You can use wget in a bat file that can be controlled with the execute function in the QV script, wget can bring you any kind of content , put it into your computer and after that you have the data from the URL and the manipulate as you need.

hector garcia

Re: how to pull data from URL which requires credentials

fdelacal — Tue, 31 Jul 2012 14:01:17 GMT

hgarcia you can put an example??...
Sharma finally you can do that?. thnaks.

Re: how to pull data from URL which requires credentials

hectorgarcia — Tue, 31 Jul 2012 14:10:30 GMT

Sure,

1) Download and install wget from http://www.gnu.org/software/wget/

2) create a QV application

3) include in teh script and execute line
should look like this

execute

cmd.exe /c wget --http-user=XXXXXXXX--http-password=YYYYYYYY--no-check-certificate -E --output-document=$(file) $(vpath);

where file is the name of the file you want to download and vpath is the destination folder where you want to store the downloaded file.

in the wget documentation you will find more parameters

Regrds

Hector

Re: how to pull data from URL which requires credentials

montubhardwaj — Tue, 31 Jul 2012 15:42:47 GMT

Yes. I am able to pull the data from URLs. All you have to do is, provide your userid and password in the url which you will write in qlikview.Example:

https://userid:password@xyz.com

If the url is related to your company or so, make sure you have access to login and view contents there.

Regards,

Sharma

Re: how to pull data from URL which requires credentials

qlikviewforum — Mon, 27 Aug 2012 06:14:53 GMT

Hi Hector

Is there is any way of doing the same without using the third party tool? Please let me know how that can be done!

Thanks,

Attitude

Re: how to pull data from URL which requires credentials

qlikviewforum — Thu, 30 Aug 2012 11:46:00 GMT

Erich Shiino wrote:
Hi,
If the website works like this, you can try a syntax like this:
http(s)://username:password@server/resource.ext

Will it work if I have @ in my password? . Also don't think this is secured way of passing the credentials. So let me know if there is any secured way of passing the credentails to sharepoint site.

Re: how to pull data from URL which requires credentials

erichshiino — Thu, 30 Aug 2012 13:07:21 GMT

Hi,

I got it from another website an I wasn't able to try it.

You should be able to replace your '@' for a hex code, like this:

user= myuser

pw=h@t

http(s)://myuser:h%40t@server/resource.ext

(replaced @ for %40)

Hope it helps,

Erich

Re: how to pull data from URL which requires credentials

qlikviewforum — Thu, 30 Aug 2012 13:24:57 GMT

Thanks! But sorry it didn't work out... Please share if you have any other alternative!

Re: how to pull data from URL which requires credentials

qlikviewforum — Fri, 31 Aug 2012 12:11:02 GMT

Hi All,

I tried my level best but unfortunately couldn't able to succeed yet.

I read some where about QVSource. Is it possible to load the data from secured sharepoint site using the same? Any help please?

Thanks,

qlikviewforum

Re: how to pull data from URL which requires credentials

Fri, 08 Mar 2013 10:29:05 GMT

Hi Erich,

I want to pull sharepoint data into qlikview which is having authentication.

Can you please help me how exactly we can pull it?

my link is "http://--.---.---.---.--/SitePages/SP_ListsDemo.aspx"

I saw so many posts on community but my problem is not yet resolved...

It will be graet if you can help me.

Thanks!

Regards,

Yojas

Re: how to pull data from URL which requires credentials

hectorgarcia — Tue, 08 Jul 2014 16:06:38 GMT

hi, since thera are many possibilities to access a protected internet page, i prefer to use this method because works with any URL

Hector

Re: how to pull data from URL which requires credentials

Fri, 13 May 2016 15:55:07 GMT

Is this method also working for redirected login?

i need to pull data from html website but when i open the link in browser

im first redirected to our corporate login page and after entering my credentials im

immediately redirected to the original url!

In qlikview i have no chance to pull the data with the original url!

Any idea?