topic Re: QS how to reduce the data ? in App Development

QS how to reduce the data ?

paulyeo11 — Mon, 31 Aug 2015 15:27:06 GMT

Hi All

I have a QS doc , i like to know how can i reduce the data to 2% ?

Binary 'lib://vFOLDER/QV4QS_v18.qvw';

I am using Binary load the data , but i like to keep the data confidential , so i want to only read 2% of the data , so that when i post the QVF file , other will not be able to know my original data source

Paul

Re: QS how to reduce the data ?

ogster1974 — Tue, 01 Sep 2015 11:01:12 GMT

Go into the debug section of your document and limit the load.

Regards

Andy

Re: QS how to reduce the data ?

paulyeo11 — Tue, 01 Sep 2015 12:41:30 GMT

Hi Andy

I have try below step 1 to 3 , and follow by reload the script , But it does not reduce to 2%. Any thing wrong ?

Re: QS how to reduce the data ?

ogster1974 — Tue, 01 Sep 2015 14:59:41 GMT

That will bring through 2 records not 2% of your records.

Re: QS how to reduce the data ?

paulyeo11 — Wed, 02 Sep 2015 01:17:22 GMT

Hi Andy

But then after i reload the script with set the limit load of 2 record , it still give me full recode , even i did a save . May i know what script does it add to my script , i mean when i set to 2 , it should have create a script to load 2 record , which i can locate the script,

Paul

Re: QS how to reduce the data ?

ogster1974 — Wed, 02 Sep 2015 12:39:45 GMT

You cannot directly filter on your binary load try this after your Binary load to reduce your data

NewFilteredTable:

NOCONCATENATE

LOAD *

RESIDENT TableNamedInLoad WHERE Your filter Criteria;

DROP TableNamedInLoad;

Re: QS how to reduce the data ?

paulyeo11 — Wed, 02 Sep 2015 15:42:09 GMT

Hi Andy

I try your script , i get error massage.

Paul

Re: QS how to reduce the data ?

ogster1974 — Wed, 02 Sep 2015 16:22:54 GMT

Whats the name of your table you are using in your qvw. you need to replace the name TableNamedInLoad with it.

Re: QS how to reduce the data ?

paulyeo11 — Wed, 02 Sep 2015 23:37:22 GMT

Hi Andy

I have change the table name to sales. I have just replace TableNamedInLoad with sales.

When i set the limit load to 10 , i get the error massage below :-

Can you give me your email , so that i can send you the QVW file ?

Paul

Re: QS how to reduce the data ?

ogster1974 — Thu, 03 Sep 2015 12:25:32 GMT

All the error message is saying is you need to put in a proper filter criteria to reduce your data.

Something like Product='ABC' I don't know your sales table data structure so don't know your field names. but basically you need as a basic filter <Fieldname> = <Fieldvalue> to limit your data by that condition. There are other ways to filter data but this type of basic filter should be enough to get you going.

Regards

Andy

Re: QS how to reduce the data ?

paulyeo11 — Thu, 03 Sep 2015 14:02:37 GMT

Hi Andy

I know my field name , BEAND_='BECKHOFF', but i don't know where to insert them into below script :-

NewFilteredTable:

NOCONCATENATE

LOAD *

RESIDENT sales WHERE Your filter Criteria;

DROP sales;

Re: QS how to reduce the data ?

ogster1974 — Thu, 03 Sep 2015 14:08:16 GMT

NewFilteredTable:

NOCONCATENATE

LOAD *

RESIDENT sales WHERE BEAND_='BECKHOFF';

DROP sales;

Note you can change the name NewFilteredTable if you want to something more appropriate to.

Re: QS how to reduce the data ?

paulyeo11 — Fri, 04 Sep 2015 00:25:49 GMT

Hi Andy

I have try it manage to filter the brand = BECKHOFF , but when it run till last line of script , it return error msg :-

Re: QS how to reduce the data ?

ogster1974 — Fri, 04 Sep 2015 06:24:25 GMT

‌DROP TABLES sales; should do the trick.

IF you get syntax type errors in future searching the community for similar examples and customising them will yeld quicker results for you and also aid your understanding of what you can do in script.

REgards

Andy

Re: QS how to reduce the data ?

paulyeo11 — Fri, 04 Sep 2015 06:35:27 GMT

Hi Andy

Finally it work now , Thank you very much. Thank you for your advise.

Paul

Re: QS how to reduce the data ?

paulyeo11 — Fri, 04 Sep 2015 11:25:43 GMT

‌HI Andy

i am wonder why the reduce script need to add filter by Brand = BRCKHOFF ? As my QVW file have many field , I imagine that reduce script should just random take 10 record from the total record and don't need add filter.

Hope you can share with me.

PAul

Re: QS how to reduce the data ?

ogster1974 — Fri, 04 Sep 2015 11:57:27 GMT

This is where you Paul need to be driving these decisions not guys on the community. The reason that was chosen as a filter was your call as you know your data.

You can filter your data on any field or fields in the table to get the right subset of data both volume and content,

Reason I would use a filter approach rather than a random approach is because at some point you are going to need to test the quality of your results i.e. does the value on the chart, table filter etc.. match what i'm expecting.

For these kinds of tests you need to be sure of your base content. Random records in my experience equals random results. fine for demoing functionality but not for testing.

Regards

Andy

Re: QS how to reduce the data ?

paulyeo11 — Sat, 05 Sep 2015 03:14:37 GMT

Hi Andy

i have try to change BRAND=HAKKO , and i noice that it only filter all record belong to HAKKO , so now i see the advantage of this approach compare to random filter .

Thank you very much for your advise.

Paul