topic Re: QlikSense is not loading complete data from the database in QlikView

QlikSense is not loading complete data from the database

santhoo_san — Wed, 06 Apr 2016 10:16:38 GMT

Hi,

I am trying to load 100mn row data from Postgrest SQL into QlikSense. It was loading properly, but suddenly it is loading only some lakh rows. I have not made any changes to the script. I also tried loading for a specific date by applying "where date=specific date", it showed right numbers. when I remove the date filter again it is loading only few rows. Can some one help, why is this happening?

Re: QlikSense is not loading complete data from the database

avinashelite — Wed, 06 Apr 2016 10:22:53 GMT

Did you check the number if rows in the DB ??? If its loading properly for specify date than I don't think the problem is with the script .. Try to check your join and where conditions once that might me limiting the records

Re: QlikSense is not loading complete data from the database

santhoo_san — Wed, 06 Apr 2016 10:43:22 GMT

Thanks for your reply Avinash.

I am loading single table. Not doing any joins and also not applying any where conditions.

Re: QlikSense is not loading complete data from the database

Chanty4u — Wed, 06 Apr 2016 10:44:48 GMT

did u add any limit load in ur data?

i u hve limit load i think it will not allow to load i think.

Re: QlikSense is not loading complete data from the database

santhoo_san — Wed, 06 Apr 2016 10:50:10 GMT

Not limiting any data. I am just adding fields from ODBC connector and loading.

Re: QlikSense is not loading complete data from the database

Chanty4u — Wed, 06 Apr 2016 10:53:38 GMT

chk ur date field as same previous values. and can u paste ur some scrpt here....till where condition.

try to restrt ur application once and give a try

Re: QlikSense is not loading complete data from the database

santhoo_san — Wed, 06 Apr 2016 11:10:47 GMT

LOAD

field1,

Date,

field3,

field4,

field5;

SQL SELECT

field1,

Date,

field3,

field4,

field5

FROM "DB"."public"."stemp_qlik"

where Date='2016-04-03';

Re: QlikSense is not loading complete data from the database

Anonymous — Wed, 06 Apr 2016 11:24:51 GMT

Hi, Santhosh,

As I understand correctly. Your script without "where Date='2016-04-03" load all the data correctly before, but only load part of the data now. Have you checked whether you have missing data in your database?

Zhihong

Re: QlikSense is not loading complete data from the database

Chanty4u — Wed, 06 Apr 2016 11:26:17 GMT

is the data available same on that day which u mentioned above with where condition?

Re: QlikSense is not loading complete data from the database

santhoo_san — Wed, 06 Apr 2016 11:29:54 GMT

if i load data for a specific date, it is loading.if i remove where condition, I am getting some strange data.

Re: QlikSense is not loading complete data from the database

Chanty4u — Wed, 06 Apr 2016 11:32:13 GMT

Ohhh....its strange.

Try to reconnect ur database and load ur data and Give a try.

Re: QlikSense is not loading complete data from the database

avinashelite — Thu, 07 Apr 2016 07:51:12 GMT

how your checking the number of rows ??

Re: QlikSense is not loading complete data from the database

santhoo_san — Thu, 07 Apr 2016 16:39:32 GMT

rowno() is also not giving the right count. when I load for a specific date, it give right count.

Re: QlikSense is not loading complete data from the database

Anonymous — Fri, 08 Apr 2016 11:49:42 GMT

Hi, the script works before, are you now loading the same data as before? If not, can you try to only load the data after update? You said you get strange data, but before you said you can only load part of the data. This seems different. What "strange data" do you mean?

Zhihong

Re: QlikSense is not loading complete data from the database

avinashelite — Mon, 11 Apr 2016 06:02:54 GMT

Your using the Rowno() function in the script or front end ???if all the data columns are same than Qlikview will treat them as one single column ...in this case also it appear like less number of rows

Re: QlikSense is not loading complete data from the database

santhoo_san — Mon, 11 Apr 2016 06:16:23 GMT

when I load a restricted data, it loads complete rows. if I load complete data without any restriction, it is loading only 15 - 20% of data only form PgSQL.

Re: QlikSense is not loading complete data from the database

santhoo_san — Mon, 11 Apr 2016 06:18:37 GMT

I used rowno() in script. column names are different (not same).

I tried creating qvds for individual dates and load to Qlik, it takes complete data from multiple qvds...!!!

Re: QlikSense is not loading complete data from the database

avinashelite — Mon, 11 Apr 2016 06:28:16 GMT

please share the sample files , will check the data

Re: QlikSense is not loading complete data from the database

santhoo_san — Mon, 11 Apr 2016 06:40:16 GMT

How can I send sample of more than 100Mn rows? I am not facing any issue in less number of data.

Re: QlikSense is not loading complete data from the database

Chanty4u — Mon, 11 Apr 2016 11:00:07 GMT

hi u can set limit load on ur file. and send it across.

u can find in Debug .