topic Generating missing data: multiple values per date in QlikView

Generating missing data: multiple values per date

sibrulotte — Wed, 18 Feb 2015 15:33:03 GMT

Hi,

there are great tutorials on how to generate a single value per date that are missing. One rate per date is not my case here.

I have a benchmark that has multiple CUSIPs per date. But my saterdays and sundays aren't populated.

I'm trying to get my script to fill Saterday's list with friday's list, and sunday's with saterday's/friday's.

Here's my scrip so far:

Benchmark_tmp:

LOAD *

, Date & CUSIP_BENCHMARK as KEY1

INLINE [

Date, CUSIP_BENCHMARK

2015-02-14, A

2015-02-14, B

2015-02-14, C

2015-02-14, D

2015-02-14, E

2015-02-14, F

2015-02-17, A

2015-02-17, C

2015-02-17, D

2015-02-17, E

2015-02-17, F

2015-02-17, G

]

;

MinMaxDate:

Load Min(Date) as MinDate,

Max(Date) as MaxDate

resident Benchmark_tmp;

Let vMinDateIndices = Peek('MinDate',-1,'MinMaxDate') - 1;

Let vMaxDateIndices = Peek('MaxDate',-1,'MinMaxDate') ;

Drop Table MinMaxDate;

Join (Benchmark_tmp)

Load

Date(recno()+$(vMinDateIndices)) as Date

Autogenerate vMaxDateIndices - vMinDateIndices;

Benchmark:

NoConcatenate

Load Date

, If( IsNull(KEY1), Peek( KEY1), KEY1 ) as KEY1

, If( IsNull(CUSIP_BENCHMARK), Peek( CUSIP_BENCHMARK), CUSIP_BENCHMARK ) as CUSIP_BENCHMARK

Resident Benchmark_tmp

Order By Date, CUSIP_BENCHMARK ;

Drop Table Benchmark_tmp;

I know the answer is going to lie with the KEY1 component, but I'm just not quite getting there.

I only get friday's last value for saterday and sunday. I want to get the whole list...

Please help?

Re: Generating missing data: multiple values per date

daveamz — Wed, 18 Feb 2015 16:04:51 GMT

Hi Simon,

If you are missing only Saturdays and Sundays then you can use something like:

Benchmark_tmp:

LOAD *

INLINE [

Date, CUSIP_BENCHMARK

2015-02-06, A

2015-02-06, B

2015-02-06, C

2015-02-06, D

2015-02-06, E

2015-02-06, F

2015-02-13, A

2015-02-13, B

2015-02-13, C

2015-02-13, D

2015-02-13, E

2015-02-13, F

2015-02-16, A

2015-02-16, C

2015-02-16, D

2015-02-16, E

2015-02-16, F

2015-02-16, G

];

//Add Saturday

CONCATENATE(Benchmark_tmp)

LOAD Date(Date+1) as Date, //Add as Saturday

CUSIP_BENCHMARK

RESIDENT Benchmark_tmp WHERE WeekDay(Date) = 4;

//Add Sunday

CONCATENATE(Benchmark_tmp)

LOAD Date(Date+2) as Date, //Add as Sunday

CUSIP_BENCHMARK

RESIDENT Benchmark_tmp WHERE WeekDay(Date) = 4;

Regards,

David

Re: Generating missing data: multiple values per date

sibrulotte — Wed, 18 Feb 2015 18:53:43 GMT

that's a good plan. Somehow my weekday result is in letters, but I made it work.

thanks

Re: Generating missing data: multiple values per date

sibrulotte — Tue, 24 Feb 2015 20:34:21 GMT

Apparently, there are more than just saterdays and sundays missing, and it's sporadic...

Back to the drawing board.

Re: Generating missing data: multiple values per date

daveamz — Fri, 27 Feb 2015 09:03:51 GMT

Hi Simon,

Can you post some sample data? Only the fileds: Date and CUSIP_BENCHMARK.

Do you want to populate missing dates with data from the last previous known date?

David

UPDATE: See if logic behind the attached script works for your data. It might run real slow on very large datasets.