Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi all,
I wanted to get opinions and best practices around combining tables. Specifically, I have 8 tables currently in my data model that all share the same key field. Each of these tables represents facts about the key field so I was thinking about combining them all into a single table. Doing this would mean instead of say 20M rows in each of the 8 tables, I would have 20M rows in a single table, but that table would have around 150 fields. The key field is only listed once per table in each of the 8 tables so I am not worried about inflating rows.
Is there a point at which it makes more sense to keep these as separate tables?
Let me know what you think.
I am concerned that doing a join on these tables will certainly cause bottlenecks in the reload. In the past, when I have done joins on large tables (10M rows) it would take around an hour. Certainly this was before trying to order the tables but I am still concerned that it might take more time than I want to sacrifice just to get all 8 tables into 1. If a table has 5 fields then I dont mind doing the Map/ApplyMap route.
Any suggestions for combing the large tables?