topic Re: Unable to pull data from CSV file in QlikView

Unable to pull data from CSV file

Tue, 24 Sep 2013 07:52:17 GMT

Hi All,

I am in the process of building a new score for one of my projects and I am facing difficulty in importing data from CSV file. The file has close 2.3 million records and while trying to import data in Qlikview only 1.4 mill records are being imported. Can some one let me know if we can pull in all the 2.3 mil reocrds are does qlikview has a limition on the number of records it can import from a .csv file.

Re: Unable to pull data from CSV file

swuehl — Tue, 24 Sep 2013 09:57:31 GMT

Should be no problem to load the 2.3 mil records.

Check if there are any special characters / quotes in your input file at the position the load stops.

Could you post your LOAD format specs? Try using 'no quotes' or remove the 'msq' style quoting.

Re: Unable to pull data from CSV file

Tue, 24 Sep 2013 10:28:40 GMT

I recently pulled in 9 million via CSV and it gave me no issues. When loading the file, what do you notice during script execution. Have you applied any transformations to the csv. Try loading it as is with the correct delimiter and nothing else into the qvw and see if all records load

Do you have a LOAD DISTINCT, could it possible be that QV is removing that volume of duplicates from the file?

Re: Unable to pull data from CSV file

jagan — Tue, 24 Sep 2013 10:29:54 GMT

Hi,

Qlikview do not have any data limitation in importing data from CSV files, check whether there are any issues with the data, open the file in Excel 2007-10 and check whether all the rows are displaying correctly.

Regards,

Jagan.

Re: Unable to pull data from CSV file

Tue, 24 Sep 2013 10:43:05 GMT

Hi,

No, there is no limit in loading data from csv file (as far as i know). This mmight be caused due to some bad data in file which is considered as end of file mark. You can try looking for any errors/issues in the file/data right after where it has stopped.

Hope it helps!

Re: Unable to pull data from CSV file

m_woolf — Tue, 24 Sep 2013 11:14:47 GMT

Look in csv file for special characters that might trigger eof. Try checking Ignore EOF in step 1 of File Wizard.

Re: Unable to pull data from CSV file

Tue, 24 Sep 2013 11:34:09 GMT

No limitation. Likely there is a problem with quotes or special characters in the file.

In the file wizard, check the Ignore EOF box and set Quoting to none.

That should fix your issues.

Re: Unable to pull data from CSV file

sushil353 — Tue, 24 Sep 2013 11:37:01 GMT

Hi,

There is no limitation in qlikview on no of records,

Check your RAM memory or eliminate the unnecessary column from csv while loading data in qlikview.

HTH

Sushil

Re: Unable to pull data from CSV file

markodonovan — Tue, 24 Sep 2013 11:46:11 GMT

Hi Venkatesh,

Are you getting any error message when the reload completes ?

Are you running the reload on the server or your own desktop ?
If on your desktop check to see if you are running out of memory.

Thanks

Mark

Re: Unable to pull data from CSV file

Tue, 24 Sep 2013 12:27:35 GMT

Thanks for the reply. I think the suggestion for Kieth worked well.