Qlik Community

Qlik Sense Cloud Discussions

alessandro_hadd
New Contributor II

Is there limitation for loading csv files?

Good afternoon everyone.

I'm starting to work with Qlik Sense and I really enjoyed the tool. However, in both desktop and cloud versions, when trying to load a large csv file, I had problems. In the case of the cloud it warns that the file can not be bigger than 50 mb. So I loaded a 38 Mb file. It loaded, but not the whole file. It has loaded up to a particular record line.

The same thing happened in the desktop version.

Can anyone tell me if there is a limitation of record lines for these versions of Qlik Sense?

1 Solution

Accepted Solutions
alessandro_hadd
New Contributor II

Re: Is there limitation for loading csv files?

I made a file analysis with ultraedit (similar to Notepad ++). I did not find anything different.

I generated the file again in a different folder. The problem persisted.

However, by changing some parameters of the load script, the file was loaded successfully.

The script that worked was as follows:

[ARRECADACAO_2014]:

LOAD [ANO],

  [MES],

  [COD_RECEITA],

  [CNPJ_CPF],

  [COD_MUNICIPIO_IBGE],

  [COUNT],

  [VALUE_VAL_TOT_ARRECADACAO_2_],

  [DES_RECEITA],

  [NOM_MUNICIPIO],

  [NOM_RAZAO_SOCIAL_CONTRIBUINTE]

FROM [lib://RESULTADOS/ARRECADACAO_2014.txt]

(txt, utf8, embedded labels, delimiter is ';', no eof);

Apparently removing the msq parameter and appending the parameter no eof, the problem has been solved.

Marcus and Lucke, thanks a lot for help.

10 Replies
Employee
Employee

Re: Is there limitation for loading csv files?

Should not happen...
Please attach or provide link to file if possible?

Re: Is there limitation for loading csv files?

alessandro_hadd
New Contributor II

Re: Is there limitation for loading csv files?

Ok Marcus. I'll do it, thank you.

alessandro_hadd
New Contributor II

Re: Is there limitation for loading csv files?

Sorry, but it´s not possible....

alessandro_hadd
New Contributor II

Re: Is there limitation for loading csv files?

Marcus,

It did not help. The file has 348,342 lines and only 80,820 lines were loaded. I did not receive any error messages.

Employee
Employee

Re: Is there limitation for loading csv files?

What is the content of line 80821 that is not loaded? Can You post that line?

alessandro_hadd
New Contributor II

Re: Is there limitation for loading csv files?

Here is a screen print showing the line 80.821 in blue ... Visually there is nothing different from the other records.print scr.PNG

Re: Is there limitation for loading csv files?

Take a look on this and the above line within an editor like notepad++ and enable the option of showing all chars inclusive any of the control-chars like line-breaks. How does your script for this load look like?

Further things you could try is loading this file from a different (a local one) path and/or to load the file with an additionally header-statement maybe 1000 lines to see if it breaks by 79821 and/or to copy the content in complete new file and store it.

- Marcus

alessandro_hadd
New Contributor II

Re: Is there limitation for loading csv files?

Ok i will try it. Thanks.

Community Browser