Changing Replicate Task Settings for Batch Tuning at Night
We use Snowflake as a Target, we'd like to reduce our Snow Credit consumption by allowing the Warehouse to Suspend longer at night. While we need Near Real Time replication during the day (1-10 Seconds), at night we can live with a longer latency (30-60 minutes). One idea is to change the Task Settings to increase the Batch Tuning Settings in "Change Processing Tuning" at 8pm and lower it again at 5am, but doing that in the UI each night is not realistic. We currently have schedules that can stop and start tasks overnight, but for some systems this is not feasible with this type of schedule.
So, I'm looking for a way to programmatically, change the settings and set them back. I've considered exporting the tasks, possibly using bash, altering the JSON, and reimporting, but that's kind of clunky, but wondering if there is a more elegant and reliable way to do something like this. Looking for ideas.
Personally, I’m not aware of a better approach than scheduling task stop and resume operations. However, if you require greater flexibility—such as dynamically changing task settings—please feel free to submit a feature request at https://community.qlik.com/t5/Ideation/ct-p/qlik-product-insight.
Hope this helps.
John.
Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
My mind goes to the same thought with the python api. Stop the task, export the json, modify the batch value, reimport the json and resume it.
It might be clunky - but if you're alerting is good to catch anything nasty happening with the swap-over and resume it sounds like a good return for little trouble.
