topic Re: Is it possible to do incremental load without qvds in QlikView

Is it possible to do incremental load without qvds

kkkumar82 — Wed, 16 Mar 2016 12:49:44 GMT

All,

Just curious to know , is it possible to perform incremental load by directly connecting to the database with out qvds.

Regards

Kiran Kumar

Re: Is it possible to do incremental load without qvds

Chanty4u — Wed, 16 Mar 2016 12:51:08 GMT

chk dis

Re: Incremental load without qvd's.

Incremental Load without using Qvd

Re: Is it possible to do incremental load without qvds

Anonymous — Wed, 16 Mar 2016 12:56:48 GMT

It is mentioned here, did you check this?

Incremental Load without using Qvd

Re: Is it possible to do incremental load without qvds

kkkumar82 — Wed, 16 Mar 2016 15:44:49 GMT

All,

I have gone through some of the posts suggested, so what I understood is , it is necessary to store the data in any format like csv, txt or qvd and from that we have to perform increment load.

So finally without having any of the storage directly connecting to a data base we cannot perform incremental loading in Qlikview.

Please correct me if I am wrong.

Thanks

Kiran Kumar

Re: Is it possible to do incremental load without qvds

jagan — Wed, 16 Mar 2016 15:50:48 GMT

Hi,

It is not possible to implement incremental loading without any temporary file QVD/CSV/Excel. You have to store the data somewhere and use it to add the new data to the existing data.

Regards,

jagan.

Re: Is it possible to do incremental load without qvds

jonathandienst — Wed, 16 Mar 2016 15:56:15 GMT

I don't really understand your points above.

The purpose of incremental loading is to avoid loading the same data from the source (database or files) over and over, but to store that data in a local file. This is useful if the source file or table is extremely large, or there are access restrictions (eg no expensive reads from a production database during working hours).

You can use any data storage format. But QVDs have some important benefits:

They are compact - although not compressed, QVD's store the data in a very concise format, so the files are smaller (compared to CSVs).
They can be written quickly.
They can be read extremely quickly - eaily 10x faster than reading from a CSV.
They maintain the data types, including dual values. So there are less issues with dates and other complex formats.

Hope that helps clarify the matter.

Re: Is it possible to do incremental load without qvds

kkkumar82 — Wed, 16 Mar 2016 16:04:46 GMT

Hi Jonathan,

The point is we were thinking is there a way that we can do incremental loading in Qlikview without qvds, I mean can we do incremental loading directly connecting to database( in our case).

As per jagan it is not possible.

I think I am clear this time.

Thanks

Kiran Kumar