Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik and ServiceNow Partner to Bring Trusted Enterprise Context into AI-Powered Workflows. Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
Vasujoshi_700
Partner - Creator
Partner - Creator

Data Flow In Qlik Cloud Analytics

In Qlik Cloud Data Flow, there is a Target option where we can select target to write datafiles eg. S3, Blob, Google drive. Can I use it instead of Qlik Talend cloud or AWS Glue to dump 300GB of data in S3?

 

Does anybody has any experiece doing this operation using Data flow (in Qlik Cloud Analytics)

 

note: i am not asking about replicate or qlik talend cloud.

Thanks and Regards,

VJ

 

 

 

 

1 Reply
Rahul_Kale
Support
Support

Hello Vasujoshi_700,

Thank you for reaching out to the Qlik community.

Qlik Cloud Data Flow is not intended for very large data exports, such as transferring around 300 GB to Amazon S3. It is primarily designed for analytics data preparation and generating small to medium-sized outputs for use within Qlik, rather than for large-scale data lake loading or ETL processes.
 

Additionally, there are system and file size limitations (such as restrictions on QVD file sizes per table), which make handling very large data volumes impractical and unsupported.
 

For large-scale data transfers to S3, Qlik recommends using Qlik Cloud Data Integration (Talend) instead of Data Flow.
 

Recommendation: Consider using Qlik Talend Cloud or AWS Glue to handle data exports of approximately 300 GB to S3.