The Full Load duration depends on factors such as data volume and network bandwidth. To optimize performance, Replicate offers features like Parallel Load to accelerate processing and Full Load Passthru Filter to reduce the dataset during the Full Load phase.
hope this helps.
John.
Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
actually in my post, i have already mentioned both options. but what i need is an example related to it which doesn't lead to data loss.
I have applied rows based approach in full load passthrough filter but this leads to missing data.
there is a column timestamp in this table which denotes the time of a document posted so it can't be changed in future, i have used this column also to fetch data till today's timestamp. but then its just stuck there. so something else is missing which is causing it to not fetch the new timestamp data.
in the meantime, replication is working and data is getting extracted but just the new timestamp data was not coming.
if you can share an example of parallel load specific to this table or passthrough filter example for ACDOCA, that would be really helpful.
