topic Load a large csv file in Data Movement & Streaming

Load a large csv file

nicoloantonietti — Wed, 19 Mar 2025 23:04:08 GMT

Platform: Qlik Cloud

Attached is the file vendite.csv

Re: Load a large csv file

Albert_Candelario — Sat, 29 Apr 2023 17:51:31 GMT

Hello @nicoloantonietti ,

Thanks for posting.

What is the challenge here? What issue do you have loading the csv file?

Cheers,

Albert

Load a large csv file

nicoloantonietti — Wed, 03 May 2023 11:28:49 GMT

I thought I added the file in the attachment of the post where I explained the issue. It seems not and I apologize.

The issue is with the loading of the file in QlikSense Cloud. It worked for years and, all of a sudden, it is not possible to load it unless it has no more than 151500.

I was asked to attach the file as an example and that's why I did that.

ID-APP: ab182acd-1456-4a57-81a7-797be113ac99

Re: Load a large csv file

Albert_Candelario — Wed, 03 May 2023 20:34:52 GMT

Hello @nicoloantonietti,

Do you have a sample csv that we could use to try to reproduce your behavior?

Cheers,

Albert

Re: Load a large csv file

fmarvnnt — Fri, 05 May 2023 07:05:03 GMT

I guys I guess this could be a support case, do U?

Regards,

FMa

Re: Load a large csv file

Albert_Candelario — Fri, 05 May 2023 11:43:02 GMT

Hello all,

If you could provide a sample csv, I would be happy to have a look with no need of a case. If afterwards a case would be needed we would share the same.

Cheers,

Albert

Re: Load a large csv file

nicoloantonietti — Mon, 08 May 2023 10:38:18 GMT

File attached.

Thank you.

Re: Load a large csv file

Albert_Candelario — Mon, 08 May 2023 13:20:12 GMT

Hello @nicoloantonietti ,

The error we are hitting is:

Data source line limit exceeded. Max line length is 1048576 bytes.

And thanks for the file. Let's dig a bit on what could be the culprit here as seems some limits are getting reached.

Cheers,

Albert

Re: Load a large csv file

Albert_Candelario — Mon, 08 May 2023 20:30:23 GMT

Hello @nicoloantonietti ,

If using the below setting it has loaded for me.

(txt, codepage is 28592, embedded labels, delimiter is ';', no quotes, no eof);

Cheers,

Albert

Re: Load a large csv file

Albert_Candelario — Tue, 09 May 2023 09:29:19 GMT

Hello @nicoloantonietti,

I have checked further and the issue is related to a known issue, QB-18874, for your reference.

The fix is already in progress, so should be delivered into the incoming weeks into our Qlik Cloud, so you can use the msq quoting again like below:

(txt, codepage is 28591, embedded labels, delimiter is ';', msq)

Cheers,

Albert

Re: Load a large csv file

nicoloantonietti — Wed, 10 May 2023 22:33:08 GMT

Hello Albert_Candelario,

I thank you for your replies and research; unfrotunately the fix you are suggesting is no working when loading the vendite.csv file.

Nicolò

Re: Load a large csv file

Albert_Candelario — Thu, 11 May 2023 14:30:23 GMT

Hello @nicoloantonietti

Do you get a different issue since it worked for me?

If so, we would need to wait for the defect mentioned to resolved.

Cheers,

Albert

Re: Load a large csv file

nicoloantonietti — Fri, 19 May 2023 08:26:30 GMT

I'm assuming the fix was ported to production as the loading is working again.

Thanks for your assistance.

Best

Re: Load a large csv file

Albert_Candelario — Fri, 19 May 2023 10:34:25 GMT

Yeap, thanks for confirming!

Re: Load a large csv file

KWF_JKassing — Tue, 20 Feb 2024 14:24:11 GMT

You're Fantastic Albert! Added 'no quotes, no eof' instead of msq and it worked!

Re: Load a large csv file

KWF_JKassing — Tue, 20 Feb 2024 14:25:55 GMT

I used msq today in Sense Cloud and it worked only with your workaround. Not with msq, maybe fix didn't solve it?