How to extract webpages data efficiently? From simple to complex...

[#1]

Hi Everybody,

I believe it is recurrent topic, but seems to be difficult to get answers.

Basically, I'm looking for methods via qlikview to extract data from webpages, not only simple html pages, but also pages where require login and some pages where require the selections and submit buttons with the address "hidden" from the browser.

My question is what is the best method and easily adaptative for most of websites.

I tried to see over the html source code, but somethimes it is hidden through java what make it more complex.

So, if somebody could explain the best way to do it using qlikview I really appreciate.

Thanks a lot,

Leandro

[rwunderlich]

Qlikview can work well with simple cases. For more complex pages or interactions, use a tool designed for the purpose (like Curl, Wget, Bixo, others. Use the tool to fetch the web data and download to files, the QV load the files.

-Rob

[#3]

Hi Rob, I can see most of the time it should be a matter of finding the "hidden" links.

Do you believe it is an easier way to get the link to add into qlikview?

maybe a software to scan the link is available...

Thanks in advance, Leandro