Qlik Community

QlikView Creating Analytics

Discussion Board for collaboration related to Creating Analytics for QlikView.

Not applicable

How to extract webpages data efficiently? From simple to complex...

Hi Everybody,

I believe it is recurrent topic, but seems to be difficult to get answers.

Basically, I'm looking for methods via qlikview to extract data from webpages, not only simple html pages, but also pages where require login and some pages where require the selections and submit buttons with the address "hidden" from the browser.

My question is what is the best method and easily adaptative for most of websites.

I tried to see over the html source code, but somethimes it is hidden through java what make it more complex.

So, if somebody could explain the best way to do it using qlikview I really appreciate.

Thanks a lot,

Leandro

Tags (2)
2 Replies

Re: How to extract webpages data efficiently? From simple to complex...

Qlikview can work well with simple cases. For more complex pages or interactions, use a tool designed for the purpose (like Curl, Wget, Bixo, others. Use the tool to fetch the web data and download to files, the QV load the files.

-Rob

Not applicable

Re: How to extract webpages data efficiently? From simple to complex...

Hi Rob, I can see most of the time it should be a matter of finding the "hidden" links.


Do you believe it is an easier way to get the link to add into qlikview?

maybe a software to scan the link is available...

Thanks in advance, Leandro

Community Browser