50MB load limit from CSV files

[nigelapt]

Team

Why can't the 50MB load limit from external files be increased?

Thanks

Nigel

[Gysbert_Wassenaar]

As far as I know Qlikview doesn't have a size limitation for loading csv files. Can you explain what you're asking about?

[m_woolf]

I'm using QV 12.1 SR8 and have no problem loading from a csv that is 335MB

[passionate]

Only limitation which Qlik has is on number of distinct records and that too is very high 2^31

[nigelapt]

Folks

Sorry its been so long to reply to this.

We write a large number of CSV files from SQL from a variety of databases to a SharePoint site.  This allows us to control the data quality and timing.

When any of the files exceed 50MB then we get this error:

Unknown LOAD statment error
Omnibus_Ticket_History:

LOAD SCOMAlertID,
     Exception,
     Node,
     EventTypeID,
     EventTicketQueue,
     TicketNumber,
     NotificationSetting,
     TicketStatus

FROM
\\xxx.xxx.xxx.net@SSL\DavWWWRoot\sites\GblSCOM\Dashboards\Documents\Omnibus\SCOM_Alerts_Daily_Report...
(txt, codepage is 1252, embedded labels, delimiter is ',', msq)

The file size is 53,845KB.

When I open in Excel, it has 29 columns and 55,604 rows.

If i reduce the file size to under 50MB it loads fine.

Would be great if I could resolve this as it really limits what we can develop.

Thanks

Nigel

[chrismarlow · Accepted solution]

Nigel,

I wonder if it something to do with SharePoint, seemingly unrelated but - Configure Maximum File Upload Size (Power Pivot for SharePoint) | Microsoft Docs refers to a 50mb size limit.

Have you tried copying the files locally & loading? Possibly try mapping a drive to avoid using the URL?

Regards,

Chris.