Qlik Community

Qlik Sense App Development

Discussion board where members can learn more about Qlik Sense App Development and Usage.

deepanshu_chamo1
New Contributor

New Data

Hello All

Please help me in the below query. I read the qlik documents but still confused.

I have connected ODBC with Qlik Sense. In SQL the data is updated every day. As there are millions of data approx 200 million data, I need to load the new data only so that it takes less time to upload the data in qvd.

I have created a variable using LET statement which contains maximum date. I am using the variable in the where statement to get the new data.

The problem I am facing is when I load the data first time; it loads the data successfully in it. But when I load the data multiple times the output is different sometimes it load all data sometimes 0 data

Ideally when I load the data again and again, the output shows 0 upload because the new data is uploaded.

I don’t have the qvd as the qvd is in other environment.

Can someone please guide the best method for incremental load in qvd and correct me also.

sunindia

swuehl

I will be grateful if someone attach the qvd where the above example suits

Thanks

Deepanshu

Tags (1)
4 Replies
Highlighted
MVP
MVP

Re: New Data

Not sure I understand the issue completely.

The problem I am facing is when I load the data first time; it loads the data successfully in it. But when I load the data multiple times the output is different sometimes it load all data sometimes 0 data

Incremental load will only incrementally load new data. If you don't have any new data, 0 rows retrieved from the data should not be a problem.

deepanshu_chamo1
New Contributor

Re: New Data

Thanks for the reply!!

The issue is when I load the data first time it loads the new data

But when I load it again it shows that data is loaded again which is not correct. The output must be 0 ideally

As per me the mistake is creating the variable and passing the variable

I have created a variable which picks the maximum post date from the table

I have passed this variable in the script in where clause as

Postdate> Max variable

Can you please brief me with the example how to go for it?

Thanks a ton in advance

Deepanshu

MVP
MVP

Re: New Data

You can find an example here

https://help.qlik.com/en-US/sense/2.2/Subsystems/Hub/Content/LoadData/use-QVD-files-incremental-load...

and here

http://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

But when I load it again it shows that data is loaded again which is not correct. The output must be 0 ideally

As per me the mistake is creating the variable and passing the variable

I think you should post the script (or a screenshot) and specify the database

deepanshu_chamo1
New Contributor

Re: New Data

Thanks sir!!

The script is in my client system, that's why I am not able to give screenshot & script.

Somehow the discussion shows the Assumed Answer, but I did not get the answer

Please suggest