topic 50MB load limit from CSV files in QlikView

50MB load limit from CSV files

nigelapt — Tue, 11 Sep 2018 13:19:13 GMT

Team

Why can't the 50MB load limit from external files be increased?

Thanks

Nigel

Re: 50MB load limit from CSV files

Gysbert_Wassenaar — Tue, 11 Sep 2018 13:25:44 GMT

As far as I know Qlikview doesn't have a size limitation for loading csv files. Can you explain what you're asking about?

Re: 50MB load limit from CSV files

m_woolf — Tue, 11 Sep 2018 13:28:41 GMT

I'm using QV 12.1 SR8 and have no problem loading from a csv that is 335MB

Re: 50MB load limit from CSV files

passionate — Tue, 11 Sep 2018 13:38:51 GMT

Only limitation which Qlik has is on number of distinct records and that too is very high 2^31

Re: 50MB load limit from CSV files

nigelapt — Tue, 06 Nov 2018 16:33:10 GMT

Folks

Sorry its been so long to reply to this.

We write a large number of CSV files from SQL from a variety of databases to a SharePoint site. This allows us to control the data quality and timing.

When any of the files exceed 50MB then we get this error:

Unknown LOAD statment error
Omnibus_Ticket_History:

LOAD SCOMAlertID,
     Exception,
     Node,
     EventTypeID,
     EventTicketQueue,
     TicketNumber,
     NotificationSetting,
     TicketStatus

FROM
\\xxx.xxx.xxx.net@SSL\DavWWWRoot\sites\GblSCOM\Dashboards\Documents\Omnibus\SCOM_Alerts_Daily_Report.csv
(txt, codepage is 1252, embedded labels, delimiter is ',', msq)

The file size is 53,845KB.

When I open in Excel, it has 29 columns and 55,604 rows.

If i reduce the file size to under 50MB it loads fine.

Would be great if I could resolve this as it really limits what we can develop.

Thanks

Nigel

Re: 50MB load limit from CSV files

chrismarlow — Tue, 06 Nov 2018 18:33:49 GMT

Nigel,

I wonder if it something to do with SharePoint, seemingly unrelated but - Configure Maximum File Upload Size (Power Pivot for SharePoint) | Microsoft Docs refers to a 50mb size limit.

Have you tried copying the files locally & loading? Possibly try mapping a drive to avoid using the URL?

Regards,

Chris.