Qlik Community

QlikView App Development

Discussion Board for collaboration related to QlikView App Development.

Highlighted
Not applicable

QV fetches not all lines

Hi all,

I try to load a CSV into my QV application but it seems that not all lines are fetched...

My CSV file has around 1.4 million lines, but only 400k were loaded.

Has QV a kind of fetching limit?

Additionally I have to say that there are entries from A-Z. So it is like QV is jumping between the lines.

Thanks,

Dave

Tags (3)
9 Replies
nagaiank
Valued Contributor III

Re: QV fetches not all lines

Are there any repeating lines in your file?

Not applicable

Re: QV fetches not all lines

No, all lines are unique

MVP & Luminary
MVP & Luminary

Re: QV fetches not all lines

Make sure there are not unprintable characters in your csv file. Also make sure you're using the correct character set. If your csv file contains utf-8 characters and you read it as if it is ascii then it will stop when an invalid character (for the specified character set) is encountered. See the Character Set page in the help file.


talk is cheap, supply exceeds demand
Not applicable

Re: QV fetches not all lines

Okay, I tried different character sets - same count of lines fetched. I have to say that I'm using a hierarchy function, nevertheless loading without the function provides the same result. And why does QV load a different count of lines for the Hierarchy Nodelist and expanded leaves (see pic)?fetched lines.JPG

Not applicable

Re: QV fetches not all lines

PowerPivot can load all 1.4 Mio entries, so it seems that my source file is okay...

Not applicable

Re: QV fetches not all lines

Try this:  add another field to your load       RecNo() as recno          and see if that makes a difference -- it may tell you which lines are being ignored... or, it may make your rows truly unique and you will find that all rows get loaded.

Re: QV fetches not all lines

The Hierarchy prefix will prevent loading records that create loops in the hierarchy (e.g. if A has B as parent, B has C as parent and C has A as parent).

Further, the Expanded leaves table will have multiple records per node if a node has several parents. If this occurs in several levels, the expanded leaves will have more records than the node list.

I suggest you load your source table without the hierarchy prefix in order to analyze what data you really have. Are there nodes with several parents? Should there be such nodes? Are there loops in the hierarchy?

QlikView can easily load 1.4 mio records, so I suspect your hierarchy has some inconsistencies.

HIC

Not applicable

Re: QV fetches not all lines

Many thanks for your responses! There was an issue in my source file. I choosed the comma as a delimiter, but some entries also had one. So the columns were shifted.

Thanks, Dave

Not applicable

Re: QV fetches not all lines

Okay, so after clearing up my source file und trying to load without the hierarchy function, QV loads exact the same count of lines as shown above...