High Ram Consumption.

[ashfaq_haseeb]

Dear all

I have two tables joined by left join

Table-1 have 230,013 records

where as table-2 have 239,992 record

all of them fetched data from database but before giving compleation message it taking too much time and ram utilization increases I have 8 gb of ram, and after fetching data and before giving sucessful reload message it consumes all 8 gb ram.

and gives me an error " ODBC" connection fale.

I'm working on SR4 Desktop Edition.

Is this error due to any bug in SR4. Or there is some logic behind

thanks in advance

Regards

Ashfaq

[mike_garcia]

Hello,

I dont think it should be an issue. I'm guessing the key is in the error message that is shown.

Are you able to read both tables if you dont perform the join operation? If not, is the password embedded in the connection string? That is sometimes the error...

Hope this helps.

Mike.

[pover · Accepted solution]

Considering the number of records and assuming the data is either text or numbers a join shouldn't take up so much memory. Make sure you have at least one column in both tables with the same name. If not, QlikView will create a table with 230,013 x 239,992 records and you will must likely run out of memory.

Regards.

[ashfaq_haseeb]

I thanked both of you.

@Mike.

Yes I can Read both the tables without joining table.

What do you think issue might be?

@Karl.

Yes I have One common column both tables with the same name.

Even though its gives me same issue and consumes all the ram.

any Ideas?

regards

Ashfaq

[#5]

instant of join please use keep keyword

example

left keep or right keep

And also sure that data type of boths field must be same .

Regards

Ashish Srivastava

[ashfaq_haseeb]

Hi Ashwin

Keep Key word take the intersection from both the tables and creates seperate table for each.

but i need to join the table taking all fields from table 1 and taking common files from table 2 that are common in table 1

for this lef join serves.

but when i load data it consumes all the memory (ram) available.

Any Idea?

Regards

Ashfaq

[#7]

please make data type of filed which you join is text

Example-

text(trim(table1.column))

left join

text(trim(table2.column))

Regards

Ashish Srivastava

[Or]

Left Join keeps everything in table1, and attaches the fields from table2 to this table, filling out these fields for any matching records found. It sounds like what you want is Left Keep, not Left Join - this will load table2 as a separate table, but will only keep records from table2 that match with table 1.

Insofar as the actual problem - could you please post the relevant part of your script? This will help with troubleshooting.

[ashfaq_haseeb]

HI All

@Ashish I tried

text(trim(table1.column))

left join

text(trim(table2.column))

it gives me same error

@OR yes you are right but finally i need to join both the table

how would i do that

Any Ideas?

Regards

Ashfaq

[#10]

Hi Ashfaq

first you make qvd both the table then after perform join operation both the qvd .

then again it give error let me know.

Regards

Ashish Srivastava