Solved: Re: Qlik Sense not loading complete data from orac... - Qlik Community

sundarakumar · ‎2018-09-27

Hi Team,

I have a table in orcale DB , when i try to load the data in Qlik sense only partial data is being loaded i.e. out of 200,000 records only 30,000 records are loaded. It happens only with a particular table and it does not throw any errors also.

any idea?

Thanks in advance.

Regards,

Sundar

sundarakumar · ‎2018-09-28

Hi All,

I was able to fix this issue with a work around.

I just added the below code in the select statement of SQL in qlik sense load editor.

Table_name:

load

country,

city,

month,

sales;

sql select country,

city,

month,

sales,

rownum as dummy_rownum,

1 as dummy_number,

'1' as dummy_num_string,

'asfdsfdsafdsfs' as dummy_string1,

'abcdefghijklmnop' as dummy_string

from tablename;

This worked for me.

I guess this is more like making a QVD load "non-optimized" in Qlik by adding a where clause or a transformation while loading the data. (refer: optimize and non-optimze load in qvd)

But here may be it is similar thing with a sql load. with a rownum we might have forced the sql to read through all the record.

Note: may be u need to change the dummy_strings lengths if you have strings of longer length.

Happy Learning:)

-Sundar

View solution in original post

timpoismans · ‎2018-09-27

Are you using the wizard to create the script to retrieve the data?

If not, try it like that to see if there's any influence on the number of rows you retrieve.

sundarakumar · ‎2018-09-27

Hi Tim,

Thanks for the response.

I tried with wizard, but i get the same result, missing records!

Any other suggestions?

-Sundar

Miguel_Angel_Baeyens · ‎2018-09-27

Check the driver and with the Oracle DBAs. Most of the cases this issue was reported in the Qlik Community was due to limitations on the amount of rows the account can extract, in either the definition of the account or the settings of the client.

sundarakumar · ‎2018-09-27

Hi Miguel,

Thanks for the response.

I doubt if this issues would be anything about extract limits. Because this issue happens with only one table. I am able to load millions of records from other tables in the same table.

-Sundar

timpoismans · ‎2018-09-27

Perhaps there's a strange symbol in the data that makes the load stop early?

Can't really give you a direct answer, never have encountered this issue, sorry.

sundarakumar · ‎2018-09-27

np. Thank you for the help.

tomasz_tru · ‎2018-09-27

Does it return always the same number of rows? Is the number of columns distincly bigger than the other tables? Maybe it's timeout?

Miguel_Angel_Baeyens · ‎2018-09-27

I don't, security can be set up by table, actually makes sense, dimensional tables have no limits, but fact tables are limited so you have to perform incremental updates.

sundarakumar · ‎2018-09-27

Could not load incrementally also. Tired loading one month of data, it breaks again.

Qlik Sense not loading complete data from oracle SQL