Connecting source: PostgreSQL and target: AWS S3 bucket using qlik replicate

[SreehariPV]

Hi team, 

I have a requirement, were I want to ingest data from PostgreSQL (source) to AWS S3 bucket (target).

Is there any specific considerations that has to be taken care here when target is a cloud instance.

[kng]

Hello Team,

Thanks for reaching Qlik community!!

Please refer the below link which helps you with the prerequisites for Amazon S3 as the target.

Prerequisites | Qlik Replicate Help

Also, we suggest taking help from our professional service team if this a new endpoint implementation.

Hope this helps!!

Regards,

shivananda

[john_wang]

Hello @SreehariPV ,

Not very sure what's the concern in your project. There are many best practices about the AWS S3 cloud includes security, performance and costs etc perspective. Below are some samples:

• Security best practices for Amazon S3
• Best practices design patterns: optimizing Amazon S3 performance
• Optimizing storage costs using Amazon S3
  & How can I reduce unexpected high costs for Amazon S3

In Qlik Replicate, besides the Limitations and considerations, depends on your project demands, we may use binary format file format Parquet, enable compression for the TEXT format file formats CSVor JSON, set a proper Maximum file sizeetc for better performance and save storage. The detailed settings can be found in User Guide. The screen sample:

Hope this helps.

John.