Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Loading a file of Huge size

Hi all,

I am trying to load two different files in qlikview client

File 1 : Size=9040 KB   RecordCount = 186387

File 2 : Size=46601KB  RecordCount = 93194

File 1 is getting loaded properly(having more records) whereas the File 2 is loading just 91000+(approx) records.

Is there any limitation of the size of the file, which can be loaded in the client.

1 Solution

Accepted Solutions
hic
Former Employee
Former Employee

No, there is no limitation. If your file contains an EOF character, this could happen. When you create your Load statement you should perhaps check "Ignore EOF".

HIC

View solution in original post

7 Replies
hic
Former Employee
Former Employee

No, there is no limitation. If your file contains an EOF character, this could happen. When you create your Load statement you should perhaps check "Ignore EOF".

HIC

marcus_sommer

The size is rather small and no there aren't limitations. Perhaps you have duplicated rows which you excluded per distinct or any other where-condition.

- Marcus

tresesco
MVP
MVP

This is not a Huge size with qv. Follow this discussion: data load problem

its_anandrjs

No in QV as such no limit if you having problem then the way to check the system RAM capacity and try to create the QVD of the tables like or may be synthetic tables created in the memory then it takes time or may be any joins.

File1:

Load * From Location;

Store File1 into File1.qvd(qvd);

Drop Table File1;

File2:

Load * From Location;

Store File2 into File2.qvd(qvd);

Drop Table File2;

Try to drop the tables after created as the QVD and then reload data from the QVD to the application.

Not applicable
Author

Hi Henric,

I have tried to load file with "Ignore EOF" checked.

It is still doing the same number of loads as earlier.

Is there any other way for that.

Thanks in advance ..

Not applicable
Author

Sorry for wrong reply,

at first load, it did not work,

now it is working fine

Thanks for help!!

hic
Former Employee
Former Employee

You need to figure out what goes wrong, and where. Here are some debug ideas:

  • Add a field "RecNo() as RecNo" in the Load, and see if the data of the highest RecNo corresponds with the last row of what you see when you open the file in notepad.
  • Look at the content of all list boxes. Is there a mismatch somewhere, like the parser has missed EndOfLine? If so, you might have a mismatch of quotes in your file. (So that QlikView sees several lines as one field value.) At which RecNo does the mismatch appear?
  • Try the "no quotes" option (in the file wizard).
  • Load the file as a fixed-record file:
    LOAD RecNo() as RecNo, @1:n as Line FROM [Filename] (fix, codepage is 1252);
    Do you get the same number of lines? Are all the Lines looking OK in a listbox or is there one where you have a mismatch?

HIC