File Source: Processing full load files using Qlik Replicate

[gvkiranreddy325]

Hi Team,

I am facing issues while loading full loading file with Qlik Replicate. I have explained the issue in given steps below:

Full File load every time >> Frequency will be for every one hour  >> Need to process latest files for every one hour

In my requirement, we used to receive the files from vendor with full set of files for every one hour, in that case they used to keep on appending the files in same location for every one hour, so Qlik replicate either to identify the latest files & to process them, or i do need to archiving the files manually after processing through Qlik Replicate every one hour which is again tricky since we don't predict when files arrives at source.

I am facing issue in identifying the options for full load with given options in Qlik Replicate, hoping can someone from Qlik support could help me on this.

Thanks in advance!!!

[OritA · Accepted solution]

Hi , 

When using file source endpoint, when running a full load task, Replicate will load all the files that were indicated in the endpoint setting under ' Location of full load data file'. 
So in your case, you should either make sure that every time you run the full load task the 'Location of full load data file' will include only the requested files to be loaded or alternatively, consider using CDC option. However, for that purpose you will have to make sure that the files structure will correlate with the requested structure as listed in the Replicate users guide. For further details please see the link below:
https://help.qlik.com/en-US/replicate/November2022/Content/Replicate/Main/File/file_change.htm#Chang...

Regards,

Orit