topic Big problem with ETL!! in QlikView

Big problem with ETL!!

Tue, 03 Jan 2012 13:08:29 GMT

Hello,

I´ve a simpele query in Oracle 10g, that retun 3675427 records.

When i´m running this query to ETL on Qlikview, they just returns 2.403.700 records.

It´s the same query!

What´s happend? Anyone seen that?

Thnak you

Big problem with ETL!!

Tue, 03 Jan 2012 14:54:47 GMT

Hi jgutheil,

as I don't think that you have any magic spells on your data, let's try to check this out:

- where does the numbers of loaded record come from (is 2.403.700 the count of rows in QV-table or is it the number taken from script progress window)

look at your two connections (qv and the other one)

- are you using the same ora-user for connecting to your ora-instance ?

- are you connecting both to the same instance ?

Regards, Roland

Big problem with ETL!!

Tue, 03 Jan 2012 15:18:41 GMT

Hi Roland,

Answering your questions.

1. The 'no of records' is in QVD file.

2. I´m using the same user, password and ora-instance.

I did a test with one single people code. There´s in a oracle database but not in QVD file.

Regards, JGutheil

Big problem with ETL!!

Miguel_Angel_Baeyens — Tue, 03 Jan 2012 15:22:03 GMT

Hi,

Are you using any WHERE condition in your LOAD script that may reduce the number of records eventually stored in the QVD file? Does your ODBC driver or your database some fetch limitation so you have reached the maximum number of records the user or the driver can get?

Hope that helps.

Miguel

Big problem with ETL!!

Tue, 03 Jan 2012 15:24:19 GMT

Hi Miguel,

No, i´m not using any WHERE clause.

Thank you

JGutheil

Big problem with ETL!!

Tue, 03 Jan 2012 15:25:14 GMT

Hi Miguel,

And i´m using OLE DB driver.

Thks

Re: Big problem with ETL!!

Miguel_Angel_Baeyens — Tue, 03 Jan 2012 16:07:34 GMT

Hi,

Does any other query to any other table return a supposedly different number of records? Do something like the following to create a counter field in your script, so you can easily check the higher number:

Data:
LOAD *,
     RecNo() AS Counter;
SQL SELECT *
FROM DB.Table;

Once you have reloaded the script, create a text object and use the Max() expression to see the highest value in field "Counter"

=Max(Counter)

Do not any STORE for the time being. Does that return the expected value?

Hope that helps.

Miguel