Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
SyedBasha
Contributor II
Contributor II

While Join the Tables Getting Duplicate values in Qliksense

How to Remove duplicates while join the tables in Qliksense

have ID column in 5 different tables getting duplicate values because of this getting huge number tried distinct method as well.

 

Labels (1)
5 Replies
Oleg_Troyansky
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi there,

Keep in mind that Qlik will match every row from the LEFT table with every row from the RIGHT table, if they have the same values of the Key fields - hence the duplication. With that in mind, you should analyze your data and decide carefully, what tables should be joined and what tables should be left separate. 

 

For example: You may have Order Lines (many lines for each Order) and Order Shipments (many lines for each Order). If you can't match these two tables 1:1 by Order Line Number, you will be joining many lines to many shipments. So, if you have 10 lines and 8 shipments for the same order, a Join will produce 80 rows.

So, pick and choose what tables should be joined, and what tables shouldn't.

Another possible issue to investigate is the meaning of the ID field. Some databases use the same field names in different tables, and they mean different things. The field ID in the Suppliers' table means Supplier ID, while the field ID in the Orders Table means Order ID. If this is the case, then you need to rename some of these different fields accordingly.

Cheers,

SyedBasha
Contributor II
Contributor II
Author

Hi Thanks for the response, finally I need to combine these tables don't have option.

ID has similar numbers in each and every table, I don't have case like order line, suppliers.

Please help me is there any other possible.

Oleg_Troyansky
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi,

In data modeling, you always have options. You just need to know the implications of different options.

As to further help, it's hard for me to do without diving deep into your data and understanding the different data entities and how they relate to each other. You need to get some basic understanding of Qlik data modeling, and then this task will get easier for you.

Look for a Qlik data modeling class, or for a good book. My book "QlikView Your Business" is one of them - it teaches all important Qlik development techniques, including data modeling - from the basics to the very advanced level.

Good luck,

SyedBasha
Contributor II
Contributor II
Author

Hi Thanks for the suggestion, this is not simple join between the tables...i am using MondoDB collection which is creating arrays collection, each array qlik has segregated separately finally based on the common key those arrays collection need combined into one transaction table and almost 30 arrays collection show's 30 tables.

Anyway I find the solution, thanks for the reply and suggestions 

Oleg_Troyansky
Partner Ambassador/MVP
Partner Ambassador/MVP

Your explanation sounds like these arrays load parts of the same transaction table into individual tables. If this is the case - each table represents a part of the same transactional table, then the solution is to CONCATENATE them, rather than JOIN them. In that case, they will all get appended into the same table, without any attempt to match the keys.

Cheers,