Qlik Replicate: AWS S3 target - dynamic names and paths

[Jon_Donker]

Hi,

We have a business requirement to have the files created by full load and change capture in AWS S3 to have the date in the file name.

So instead of:

s3://landing/system/schema.table/LOAD00000001.json

Something like:

s3://landing/system/yyymmdd/schema.table/LOAD_yyymmdd_00000001.json

We can probably do this with a post processing call; but wondering if there is a hidden trick in QR to achieve this.

[OritA · Accepted solution]

Hi, 

As stated in the Replicate users guide under the following link this is the product behaviour:

https://help.qlik.com/en-US/replicate/May2023/Content/Replicate/Main/Amazon%20S3/file_as_target_over...

"Full Load files are named using incremental counters e.g. LOAD00001.csv, LOAD 00002.csv, etc. whereas Apply Changes files are named using timestamps e.g. 20141029-1134010000.csv."

There may be an option to achieve your need using  the 'post upload processing' option that appears under the endpoint advance tab using the option 'Run command after upload'.  However, this needs to be tested. If you wish please open a case so we can test it in the lab and let you know if this option can help in your case. 

Otherwise, if you wish to have a simple way to do it,  you can open an ideation request to our PM so they can consider adding this option in one of the futer releases. 

Regards,

Orit