In this article, we address best practices through a questionnaire for Qlik Replicate administrators and architects before an environment goes live in production. Having answers to these questions is helpful for a successful deployment and sustainable implementation.
Content:
Pre-deployment
- Is is possible to perform a POC? If a POC already occurred, what would you like to repeat or avoid?
- Are the source and target endpoint versions in compliance with Replicate Support Matrix?
- Which role is in charge of installing correct drivers and pre-requisites? DBAs, Replicate administrators, systems engineers, etc.
- What type of replication will you be requiring (Store changes, Apply changes, both, bi-directional, full load only etc.)?
- Although driven by your Replicate license, it is helpful to define the following:
- Number and types of sources
- Number and types of targets
Qlik Professional Services
- Is there a process or budget to engage Qlik Professional services for the following?
- Implementing new endpoints
- Performance tuning task settings
Source
- Is there a source DBA available to help configure source connection? Are they available for troubleshooting?
- What are the source log retention limitations?
- Does Qlik Replicate have proper permissions configured to source DB?
- Test opportunity: Work with Source DBA to confirm security policy and test permissions access to tables
- If three or more tasks connecting to a source database, have you considered implementing Log Stream?
Source Sizing
- Please work with Qlik Replication project owners and administrators to define values for the following:
- Rate of source changes
- Number of source schemas
- Number of source tables
- Size of all tables (rows, data)
- Do tables have LOB columns? If so, how many tables and what size?
Sizing
- Define the location of Servers (source, targets, Qlik Replicate) type (on premise, cloud, on premise virtual machine)
- Is there hardware already procured to work with or can Qlik help size the hardware (Professional Services)?
- What is the network bandwidth available between endpoints and Qlik Replicate?
- Qlik Replicate disk storage size (disk requirements if changes are written to disk)
- Is your \data folder location in a separate location from the Qlik Replicate install folder?
- If using log stream, is your storage path on a separate drive from your /data directory? This can help with disk contention by having separate drives.
- What is your acceptable latency requirement (time from source commit to target commit)?
Testing
- Define number of environments DEV, QA/TEST, PROD
- Do you have at least 1 non-production environment that mirrors production for data volume, data types, and processes?
- Define a testing plan, scripts, queries for:
- Validating row counts between source and target
- Validating any filters or transformations
- Validating failover if a HA/failover environment
- Validating query times on source and target. If needed, reduce the batch size or increase timeout parameters.
- Validating row size limits
- Practicing a Advanced Run Options -> Restart from time or SCN/LSN (and when to use these options)
- Adding or removing a table from a task
- Apply Conflicts settings such as UPSERT mode
- How do we handle maintenance or upgrades on Source DB and target DB? How often do we expect these to occur?
Additional Administration
- How many users will be engaging with Qlik Replicate at one time? Who is responsible for managing adding, removing or configuring users?
- Are notifications configured on server or task errors? For Disk/CPU limits? What emails are included to receive notifications?
- Is there a naming convention established for sources, targets, and tasks?
- Is there a change control strategy in place? Qlik Enterprise Manager has audit trail capabilities if also installed with Qlik Replicate environment.
Table and data level
- Do tables have PKs? Are PKs changing on any tables? Tables with a PK which is not changing will have the best performance with bulk apply mode.
- For change data capture: are you using Transactional apply vs Bulk apply?
Go live
- Do we bring all task online at once or can they be started sequentially or in batches?
Support
- How long will it take to perform a full reload on each task?
- Are there any task/tables where a Full load is not an acceptable option?
- Do you know how to increase Task and Server logging and/or download diagnostic package?
- Do we have a team who can manage 24 hour Severity 1 Support?
- What is process for applying Qlik Replicate service packs with fixes? (i.e Dev then prod, or direct on Prod, how quickly can these fixes be applied?)
- Are you familiar with decrypting log files?
- Does your team have access to the Case Portal?
Security
- Have you tested access to the system with set password?
- Has openSSL been set up and configured for Qlik Replicate UI Console and Server?
Related Content
How To Get Started with Qlik Replicate
Environment
Qlik Replicate
The information in this article is provided as-is and to be used at own discretion. Depending on tool(s) used, customization(s), and/or other factors ongoing support on the solution below may not be provided by Qlik Support.