How many record can be loaded from CSV file

[#1]

Dear all.

I am using the following code to load the data into qlikview from a csv file. I have 40k+ records in the CSV. But when i display the data in a table box. It only give me 19k+ records.

May i know is there any limitation on this or on the table box itself? How do i count the total number of record as well?

Directory;

LOAD D_PO,

     D_PARTNO,

     D_DESCRIPTION,

     D_UNIT_COST,

     D_ACCEPTED_QTY,

     D_ORDER_PLACED,

     D_YEAR,

     D_PERIOD,

     D_SUPPLIER,

     D_NAME,

     D_DEBITACCT,

     D_DEBITAMT,

     D_CREDITACCT,

     D_CREDITAMT

FROM

\\sgs-bit-01\QlikView\AccessPoint\DATA\donepo.csv

(txt, codepage is 1252, embedded labels, delimiter is ';', msq);

[Clever_Anjos]

There´s no physical limitation but your RAM capacity.

Please check

1) If there´s empty lines into your file

2) Check using Table Viewer (Control-T) how many lines were read

using a table box can lead to wrong counting, because duplicate lines are skipped

[#3]

Dear all,

Just did some try and i realise the problem might be on the load statement.

if i change this line

(txt, codepage is 1252, embedded labels, delimiter is ';', msq);

to

(txt, codepage is 1252, embedded labels, delimiter is ';');

then it gives me 39k+ record. Although still less than records in original csv. Can somebody advise what is msq? is my load script correct?

[Clever_Anjos]

You script seems correct, please check my previous answert

[#5]

?? table skip the duplicate line? Then what is the best way to have a listing view like database table view?

[jagan]

Hi,

Try like this

Data:

LOAD

*,

RowNo() AS RecordNumber

FROM FileName.csv;

Now add all the fields including RecordNumber in the Table box, it will show all the records, now there are no duplicates since there is unique record number for each row.

Hope this helps you.

Regards,

Jagan.

[Clever_Anjos]

Jagan Mohan gave what you need to create totally distinct lines

[#8]

Hi Mohan,

Below is what i have tested

1) Based on your script. i got all the record show 41887 (all records)

2) if i use my script and add 'RowNo() AS RecordNumber' then i got 41887

3) if i use my script without  'RowNo() AS RecordNumber' then i got 36927 after export to excel

But all these result change to less if i include the msq like below. May i know what is msq?

(txt, codepage is 1252, embedded labels, delimiter is ';', msq);

And why the result different with recordnumber and without the recordnumber?

[jagan]

Hi,

From Reference manual

msq(modern style quoting) indicates that the style of quotation marks is taken modern.

This only applies for files of type txt.

Regards,

Jagan.

[#10]

Ok. I will exclude msq

But may i know how come the script give me difference result if i include and exclude the below line?

include : RowNo() AS RecordNumber = ALL RECORDS SHOWN 41887

Excldue : RowNo() AS RecordNumber = ALL RECORDS SHOWN 36K+