topic How loading web data automatically until its last page ? in QlikView

How loading web data automatically until its last page ?

prahlad_infy — Wed, 25 Nov 2020 16:16:04 GMT

Hello Sirs ,

Let say there is web page hypothetically

http://teams/‌abc/Page1

http://teams/‌abc/Page31

http://teams/‌abc/Page61

http://teams/‌abc/PageN

How to load data to from page 1 to page N ....

Important : We do not know the value of N as daily new pages gets increased.

I using below code :

For i = 1 to 1000

set vPage1part= ' http://teams/‌abc/Page' ;

let vStartPage = $(i) ;

Load

From

$(vPage1part)&$(vStartPage) ;

Trace $(i) ;

let vStartPage= $(i) + 30 ;

STORE X into ..............\X.qvd ;

Thank you

Re: How loading web data automatically until its last page ?

rubenmarin — Thu, 07 Jun 2018 16:53:27 GMT

Hi Prahlad, I don't know if there is any other way if you don0t previously know the value N, maybe using ErrorMode=0 and checking ScriptErrorCount to know where to stop.

https://help.qlik.com/es-ES/qlikview/November2017/Subsystems/Client/Content/Scripting/ErrorVariables/ErrorVariables.htm

Re: How loading web data automatically until its last page ?

prahlad_infy — Thu, 07 Jun 2018 17:05:04 GMT

Hello Ruban ,

Can you please share the code ? I am new and not totally sure .

Re: How loading web data automatically until its last page ?

rubenmarin — Thu, 07 Jun 2018 17:13:54 GMT

Do a copy of your current state, I haven't tested it:

Before your bucle starts add, note that after this sentence script errors won't stop the execution of script

SET ErrorMode=0;

Inside the bucle, after the load add:

EXIT FOR WHEN ScriptErrorCount>0;

After the bucle restore ErrorMode

SET ErrorMode=1;