topic Re: Duplicate values in QlikView

Duplicate values

Anonymous — Mon, 23 Sep 2013 17:03:29 GMT

Hi All..I am using incremantal load in my application. I am loading everyday qvd in my application.

ID Name

110 Ram

110 Sam

After loading in my application when I select ID 110 in Name field Ram and Sam both coming.

But I want only latest edited data.

I have Last Edited Date also in my application.in which all the history of edited date is coming. But only latest edited date should be displayed. In QVD Generator its coming correct but in application its displaying duplicate values as same ID would have edited on someother day also. So its taking all the edited date.

Please help me on this

Re: Duplicate values

Ricardo_Gerhard — Mon, 23 Sep 2013 20:37:55 GMT

You have a problem with join or load process.

Look all QVD to find the ID 110 and your values.

Qlikview use field name to link tables that have the same values.

Re: Duplicate values

Anonymous — Tue, 24 Sep 2013 06:17:45 GMT

I am not linking it. directly loading everyday qvd by giving *

I am loading everyday qvd by giving Today() and loadinnnng all the qvd to fact by giving (*) for example Table*

So all the qvd getting loaded.

Re: Duplicate values

yavoro — Tue, 24 Sep 2013 08:16:58 GMT

What I would do is to flag during the load what latest records are. For example - a field LatestEditeData with values Y or N. And the by selecting Y you will get what you want. The thing is to create that field.

Hope that helps.

Re: Duplicate values

Tue, 24 Sep 2013 08:31:08 GMT

Is it possible to share your qvw? There are a number of potential issues, it could be your table links, it could be your date formats, it could be your set analysis, it could be your script. I had a similar issue that turned out to be the date format.

Without seeing more it would be difficult to tell. Any additional information would be useful.

Regards

Steve

Re: Duplicate values

Tue, 24 Sep 2013 09:21:41 GMT

Can you use a where clause like: where not exists (Key,Key); ?

Re: Duplicate values

amars — Tue, 24 Sep 2013 10:04:17 GMT

Hi Rajesh,

As you said you are loading all the QVD's using *, I think the extra records are coming from your previous QVD's.

I think that your old QVD's contain OLD Stagenent Data and are not refreshed for the Updated records.

Please check your QVD Generator to check if you flush out the Old Records using Not Exists.

Thanks...

Re: Duplicate values

Anonymous — Tue, 24 Sep 2013 11:42:12 GMT

Y yavor, I got your point...what flag you telling I am having Last_Edited Date as flag.

In my qvd generator it calculates max(Last_edited Date) and load datas.

But in my main application while loading it I am loading all dates data..so there is possibility that same field may be edited on 09/09/2012 and also 23/09/2012. So if i load load the qvd_date wise then i will have old date data s well as new date data.

Should I join left join??will it work ?

Re: Duplicate values

somenathroy — Tue, 24 Sep 2013 12:08:31 GMT

If possible pls send a sample qvw file or provide some more info regarding your table structure.

Regards,

som

Re: Duplicate values

yavoro — Tue, 24 Sep 2013 12:50:48 GMT

well, in your main application you can find the records with max date and flag them as latest.

yeah, you should left join grouped max(Last_edited Date) by your ids, to the main data.