Skip to main content
Announcements
Qlik Connect 2025: 3 days of full immersion in data, analytics, and AI. May 13-15 | Orlando, FL: Learn More
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Unable to pull data from CSV file


Hi All,

I am in the process of building a new score for one of my projects and I am facing difficulty in importing data from CSV file. The file has close 2.3 million records and while trying to import data in Qlikview only 1.4 mill records are being imported. Can some one let me know if we can pull in all the 2.3 mil reocrds are does qlikview has a limition on the number of records it can import from a .csv file.

1 Solution

Accepted Solutions
Not applicable
Author

No limitation. Likely there is a problem with quotes or special characters in the file.

In the file wizard, check the Ignore EOF box and set Quoting to none. 

That should fix your issues.

View solution in original post

9 Replies
swuehl
MVP
MVP

Should be no problem to load the 2.3 mil records.

Check if there are any special characters / quotes in your input file at the position the load stops.

Could you post your LOAD format specs? Try using  'no quotes' or remove the 'msq' style quoting.

Not applicable
Author

I recently pulled in 9 million via CSV and it gave me no issues. When loading the file, what do you notice during script execution. Have you applied any transformations to the csv. Try loading it as is with the correct delimiter and nothing else into the qvw and see if all records load

Do you have a LOAD DISTINCT, could it possible be that QV is removing that volume of duplicates from the file?

jagan
Luminary Alumni
Luminary Alumni

Hi,

Qlikview do not have any data limitation in importing data from CSV files, check whether there are any issues with the data, open the file in Excel 2007-10 and check whether all the rows are displaying correctly.

Regards,

Jagan.

Not applicable
Author

Hi,

No, there is no limit in loading data from csv file (as far as i know). This mmight be caused due to some bad data in file which is considered as end of file mark. You can try looking for any errors/issues in the file/data right after where it has stopped.

Hope it helps!

m_woolf
Master II
Master II

Look in csv file for special characters that might trigger eof. Try checking Ignore EOF in step 1 of File Wizard.

Not applicable
Author

No limitation. Likely there is a problem with quotes or special characters in the file.

In the file wizard, check the Ignore EOF box and set Quoting to none. 

That should fix your issues.

sushil353
Master II
Master II

Hi,

There is no limitation in qlikview on no of records,

Check your RAM memory or eliminate the unnecessary column from csv while loading data in qlikview.

HTH

Sushil

markodonovan
Specialist
Specialist

Hi Venkatesh,

Are you getting any error message when the reload completes ?

Are you running the reload on the server or your own desktop ? 
If on your desktop check to see if you are running out of memory.

Thanks

Mark

Not applicable
Author

Thanks for the reply. I think the suggestion for Kieth worked well.