Qlik Community

Qlik Sense App Development

Discussion board where members can learn more about Qlik Sense App Development and Usage.

korsikov
Valued Contributor II

how store QVD in new format?

hello all.

I am doing some tests.

Сreate QVD in QlikView 11.20, QlikView12 and Qlik Sense 2.0.3

the result was 3 files created in three versions

hen I load the data from these files in different versions.

All this file load in QV 11.20

11.20

qv11.20 << qlikview11.20 (qvd optimized) 26 lines fetched

12

qv12 << qlikview12 (qvd optimized) 1 942 lines fetched

QlikSEnse << qliksense (qvd optimized) 191 lines fetched

in QlikView 12

11.20

qv11.20 << qlikview11.20 (old qvd (row based) optimized) 26 Lines fetched

12

qv12 << qlikview12 (old qvd (row based) optimized) 1 942 Lines fetched

QlikSEnse << qliksense (old qvd (row based) optimized) 191 Lines fetched

in Qlik Sense v 2.0.3

---

Выбранные строки: 1 971 qw11.20 << qlikview11.20 (файл QVD в виде строк оптимизирован) Выбранные строки: 26 qv12 << qlikview12 (файл QVD в виде строк оптимизирован) Выбранные строки: 1 942 QlikSense << qliksense (файл QVD в виде строк оптимизирован) Выбранные строки: 191

---

файл QVD в виде строк оптимизирован - File QVD row based optimized


Question

How store QVD in new format?


In old version Qlik Sense generate message (QVD file generated by version 11.2 or lower was detected. Use STORE INTO to optimize and columnize this file.)



vd (row based) optimizedqvd (row based) optimized

Tags (2)
1 Solution

Accepted Solutions
darkhorse
Valued Contributor

Re: how store QVD in new format?

Hi Alexander,

I tested with Sense 2.1.1. Even more interesting results: Old format message does not appear anymore; instead it says row-based only. Interestingly if I store the QVD, message does not change; meaning it probably stores it in row-based again.

So there seems no difference between 11.x and Sense QVD formats. It used to say column-based in earlier Sense versions.

My personal wild guess is they rolled back from that decision due to some technical problems. We had a few issues with columnar format in earlier version tests such as columnar taking more space and time to load into memory. It was demonstrable in big data sets.

BR

Serhan

8 Replies
seebach
Contributor III

Re: how store QVD in new format?

Hi Alexander,

The short answer is no cannot store in a different QVD format. Qlik officially says where is only a single format. In Qlik Sense 1.0 and 1.1 its correct there existed a column QVD format. But this has been changed in 2.0, to the same format as QlikView 11 uses. QlikView 12 should therefor use the exact same format as previous versions.

I can see your load editor gives you a different message. But can you check that load times are the same? If they are then its just bad messaging from Qlik and maybe you should report it.

korsikov
Valued Contributor II

Re: how store QVD in new format?

Thank you for your explanation, Torben.

If all the applications are using the file format version 11.20, what version of 12 displays the message "old QVD"?

But I think it's more a matter as of version 12, not Sense

seebach
Contributor III

Re: how store QVD in new format?

According to Qlik those filetypes are identical. Is the load time identical?

The main difference between the columnar and row based types (the one that shortly existed in Qlik Sense 1.0 & 1.1) was that when Qlik Sense loaded the QlikView 11.2 format, it was much slower.

If the speed is the same, then there should not be a format difference, merely some code that does not display the right message.

korsikov
Valued Contributor II

Re: how store QVD in new format?

I can not answer at once. this requires additional research.

darkhorse
Valued Contributor

Re: how store QVD in new format?

Hello Alexander,

Maybe I'm missing something here but if you store the qvd in Sense, then it happens to be the new format and the old format message disappears if you load it again in Sense (did not try in QlikView 12 but should be the same behaviour since using the same engine). Is this the question?

BR

Serhan

korsikov
Valued Contributor II

Re: how store QVD in new format?

In older versions it was. In Version 2.0.3 stores the data in the ARC file. Next, load the file of the same version of the sensei, I receive an error that the file is old format, row based

darkhorse
Valued Contributor

Re: how store QVD in new format?

Hi Alexander,

I tested with Sense 2.1.1. Even more interesting results: Old format message does not appear anymore; instead it says row-based only. Interestingly if I store the QVD, message does not change; meaning it probably stores it in row-based again.

So there seems no difference between 11.x and Sense QVD formats. It used to say column-based in earlier Sense versions.

My personal wild guess is they rolled back from that decision due to some technical problems. We had a few issues with columnar format in earlier version tests such as columnar taking more space and time to load into memory. It was demonstrable in big data sets.

BR

Serhan

korsikov
Valued Contributor II

Re: how store QVD in new format?

I agree. Asked a similar question in the thread Betatest QlikView12,  Qlik said that all versions will use the current format QVD file and a road map no plans to change it.