topic Re: how store QVD in new format? in App Development

how store QVD in new format?

korsikov — Tue, 15 Sep 2015 08:04:51 GMT

hello all.

I am doing some tests.

Сreate QVD in QlikView 11.20, QlikView12 and Qlik Sense 2.0.3

the result was 3 files created in three versions

hen I load the data from these files in different versions.

All this file load in QV 11.20

11.20
qv11.20 << qlikview11.20 (qvd optimized) 26 lines fetched
12
qv12 << qlikview12 (qvd optimized) 1 942 lines fetched
QlikSEnse << qliksense (qvd optimized) 191 lines fetched

in QlikView 12

11.20
qv11.20 << qlikview11.20 (old qvd (row based) optimized) 26 Lines fetched
12
qv12 << qlikview12 (old qvd (row based) optimized) 1 942 Lines fetched
QlikSEnse << qliksense (old qvd (row based) optimized) 191 Lines fetched

in Qlik Sense v 2.0.3

---

Выбранные строки: 1 971 qw11.20 << qlikview11.20 (файл QVD в виде строк оптимизирован) Выбранные строки: 26 qv12 << qlikview12 (файл QVD в виде строк оптимизирован) Выбранные строки: 1 942 QlikSense << qliksense (файл QVD в виде строк оптимизирован) Выбранные строки: 191

---

файл QVD в виде строк оптимизирован - File QVD row based optimized

Question

How store QVD in new format?

In old version Qlik Sense generate message (QVD file generated by version 11.2 or lower was detected. Use STORE INTO to optimize and columnize this file.)

vd (row based) optimizedqvd (row based) optimized

Re: how store QVD in new format?

tseebach — Tue, 15 Sep 2015 08:16:22 GMT

Hi Alexander,

The short answer is no cannot store in a different QVD format. Qlik officially says where is only a single format. In Qlik Sense 1.0 and 1.1 its correct there existed a column QVD format. But this has been changed in 2.0, to the same format as QlikView 11 uses. QlikView 12 should therefor use the exact same format as previous versions.

I can see your load editor gives you a different message. But can you check that load times are the same? If they are then its just bad messaging from Qlik and maybe you should report it.

Re: how store QVD in new format?

korsikov — Tue, 15 Sep 2015 11:01:29 GMT

Thank you for your explanation, Torben.

If all the applications are using the file format version 11.20, what version of 12 displays the message "old QVD"?

But I think it's more a matter as of version 12, not Sense

Re: how store QVD in new format?

tseebach — Tue, 15 Sep 2015 11:18:08 GMT

According to Qlik those filetypes are identical. Is the load time identical?

The main difference between the columnar and row based types (the one that shortly existed in Qlik Sense 1.0 & 1.1) was that when Qlik Sense loaded the QlikView 11.2 format, it was much slower.

If the speed is the same, then there should not be a format difference, merely some code that does not display the right message.

Re: how store QVD in new format?

korsikov — Tue, 15 Sep 2015 11:24:55 GMT

I can not answer at once. this requires additional research.

Re: how store QVD in new format?

Anonymous — Wed, 16 Sep 2015 12:32:06 GMT

Hello Alexander,

Maybe I'm missing something here but if you store the qvd in Sense, then it happens to be the new format and the old format message disappears if you load it again in Sense (did not try in QlikView 12 but should be the same behaviour since using the same engine). Is this the question?

Serhan

Re: how store QVD in new format?

korsikov — Wed, 16 Sep 2015 12:37:49 GMT

In older versions it was. In Version 2.0.3 stores the data in the ARC file. Next, load the file of the same version of the sensei, I receive an error that the file is old format, row based

Re: how store QVD in new format?

Anonymous — Wed, 16 Sep 2015 12:49:09 GMT

Hi Alexander,

I tested with Sense 2.1.1. Even more interesting results: Old format message does not appear anymore; instead it says row-based only. Interestingly if I store the QVD, message does not change; meaning it probably stores it in row-based again.

So there seems no difference between 11.x and Sense QVD formats. It used to say column-based in earlier Sense versions.

My personal wild guess is they rolled back from that decision due to some technical problems. We had a few issues with columnar format in earlier version tests such as columnar taking more space and time to load into memory. It was demonstrable in big data sets.

Serhan

Re: how store QVD in new format?

korsikov — Wed, 16 Sep 2015 13:10:22 GMT

I agree. Asked a similar question in the thread Betatest QlikView12, Qlik said that all versions will use the current format QVD file and a road map no plans to change it.