Script Testing - Filtering Help

[kwarren1]

Hello,

The following script statement is still scanning through 50 Million records and taking about 15 minutes to re-load the script. Is there anything I can do to more effectively filter or retrieve a sample or smaller size of the records I need in order to ensure testing?

tempDayPoint_Measurement_Summry1:

LOAD

  *

  Resident Point_Measurement

  Where _kHour_Quarter_ID_Autonumber <= (100)

[MarcoWedel]

maybe using the sample prefix:

Sample ‒ QlikView

hope this helps

regards

Marco

[adamdavi3s]

You can also use the option under debug to load just x number of rows.

This will just load the first x, Marco's solution is probably better for testing as it will provide a random sample.

[berkarmagan]

Just use debug on reload page, u can get your sample faster.

[Anonymous]

Hi Kevin, use first statement to load the number of first rows that you want to load. If your statement is SQL, then use top functions to do it.

Regards!

[kwarren1]

Unfortunately the source is not OLE DB or ODBC so SQL statements are not an option

[kwarren1]

Marco. Thanks for the response, but the sample prefix actually makes the load go slower. I put in "sample .1 " before the load statement and it seemed to move at 1 tenth of the speed instead of running 10 times faster because only a tenth of the data was being pulled.

[el_aprendiz111]

Hi,

tempDayPoint_Measurement_Summry1:

First 1000 // 20000, 30000 any amount

LOAD

  *

  Resident Point_Measurement

[kwarren1]

thank you. Your post was helpful, but bloomed a more direct question.

I was hoping there would be an option to load specific chunks of data for testing. For example, If my data set was 12 months for year 2015, It would be ideal to pull 1 specific month worth of data to cross reference and check against the source document.

It is helpful to have first 1000 records, but it is not specific to something I can test against. I will try ordering my fact table by date asc so I can pin-point the exact row of when my first month ends.

This method is only possible for January or December checking.

Isn't there an equivalent to the SQL Where Statement in Qlik Scripting?

[Anil_Babu_Samineni · Accepted solution]

Try with transpose

tempDayPoint_Measurement_Summry1:

LOAD

  *

  Resident Point_Measurement

  Where _kHour_Quarter_ID_Autonumber <= (100)

STORE tempDayPoint_Measurement_Summry1 into Path\tempDayPoint_Measurement_Summry1.qvd (qvd);

Then Load that qvd into Qlikview

Here, qvd is negotiate / reduce the Time elapse