Hi There,
My Scenario:
I have a table with the following contents:
| ID | Category ID | Category | Score |
|---|
| 122 | 1 | Innovation | Excellent |
| 122 | 12 | Loyalty | Excellent |
| 122 | 15 | Overall | Average |
And my task is to have this data converted into one row , so that we can perform our analysis, the table should look like this:
| ID | Innovation | Loyalty | Overall |
|---|
| 122 | Excellent | Excellent | Average |
I am using the following script in my Load statement:
RawData:
Load
ID,
Category ID,
Category,
Score,
(There are like 10 more fields , but i want to focus only on the above)
From Table
Ratings:
Load
ID,
Score as Innovation
Resident RawData
where Performance Category = "1"
Outer Join (Ratings)
Load
ID,
Score as Loyalty
Resident RawData
where Performance Category = "12"
I do this for around 10 categories and for the first 2-3 my loading time is around 24 seconds , but as soon as i start to add more categories my whole pc crashes or if i leave it the loading time is around 5-6 hours which is something that is unacceptable for my client.
The first table that i am loading has around 300 000 rows of data.
Is there a workaround where I can get what i need , but to reduce the loading time in general?
Many Thanks,
Atanas
