Welcome to August's Qlik Data Integration newsletter. Each month, we cover one endpoint and share our top resources, best practices, release updates and upcoming webinars.
Subscribe to theQlikData Integrationtopic to be notified of future editions!
Index
Resource HighlightsReminder! Qlik Replicate Endpoint RetirementKnowledgebase ArticleEndpoint Spotlight: DatabricksNew Issues ReportedTips!Release UpdatesFixesUpcoming EnhancementsTroubleshooting tipsAnalyze Qlik Replicate LogsQlik Data Integration Product End of Life Versions
Resource Highlights
Reminder! Qlik Replicate Endpoint Retirement
As of July 31st, 2023, the following endpoints have been retired:
Source Endpoints:
HP Non-Stop Source
Open VMS RMS Source
Hadoop Source
Target Endpoints:
MapR Target
MapR Streams Target
MS APS PDW Target
SAP Sybase IQ Target
HP Vertica Target
Actian Vector Target
Netezza Target
Pivotal Greenplum Target
SeeRetirement for Specific Qlik Replicate Endpointsfor details.
Knowledgebase Article
Endpoint Spotlight: Databricks
Find our latest knowledge base articles for Databrick endpoints.
New Issues Reported
Error SSL_connect: wrong version number when using Databricks Lakehouse (Delta) as target
Find the resolution in Qlik Replicate with Databricks Lakehouse (Delta) as target: Error SSL_connect: wrong version number.
Performing operations in transactions apply mode is not supported with Databricks Lakehouse (Delta) as target
TheApply Changesreplication mode supports tables with a Primary Key only. For solutions seeQlik Replicate with Databricks Lakehouse (Delta) as target: Performing operations in transactions apply mode is not supported in log.
Table is failing on full load when loading into Microsoft Azure Databricks Delta Target
Find the resolution inQlik Replicate: Table is failing on full load when loading into Microsoft Azure Databricks Delta Target.
Qlik Replicate Server crashes when browsing databases in Microsoft Azure Databricks Target
ClickingBrowsein the database endpoint settings of a Microsoft Azure Databricks target crashes the Qlik Replicate server.Find the resolution inQlik Replicate Server crashes when browsing databases in Microsoft Azure Databricks Target.
Tips!
Qlik Replicate and Databrick Unity Catalog feature flag support
Qlik Replicate added support for Databricks Unity Catalog using feature flag from 2022.11 SP02. SeeQlik Replicate added support for Databricks Unity Catalog using feature flag from 2022.11 SP02for details.
Qlik Replicate: Databricks Operations per second is over the account limit
Qlik Replicate tasks may fail with Operations per second is over the account limiterrors. Find the resolution in Qlik Replicate: Databricks Operations per second is over the account limit.
Best Practice:Qlik Replicate: Databricks Delta Wstring data type truncation
Starting withDatabricks Delta Driver version to 8.x and above, Varchar data type will be used for strings. Varchar data type is no longer limited by this character size so no truncation will occur when Wstring data type is used with limits higher than 255 characters.
Release Updates
Fixes
Qlik Replicate May 2023 patches
Component/Process: Databricks (Cloud Storage)
Description: When reconnecting after recoverable error on uploading file, the last file does not get uploaded, resulting in missing data.
Component/Process: Databricks Lakehouse (Delta)
Description: When using merge, if one of the columns in a Unique Index was NULL the changes would not be applied correctly. The issue was resolved using a Feature Flag at task and server level.
Upcoming Enhancements
Qlik Replicate August 2023 IR
New Confluent Endpoint (based on Kafka)
S3 authentication support with AWS IAM Roles Anywhere on S3/Redshift endpoints
Ability to Set Isolation Level on ODBC with CDC (Ability to Set Isolation Level on ODBC with CDC)
Qlik Replicate November 2023 IR
Expose stream buffer tuning parameters in task settings (Replicate & QEM - Expose stream buffer tuning parameters in task settings)
Confluent Schema Register using BOTH authentication methods (Public Key + Username & password)
Snowflake - Support Transactions in Upsert Mode
Boolean Data Type support for PG sources and Bit support for SQL Server targets
Google BigQuery - Secure current authentication (no longer have credential files on customer file system)
Aurora PostgreSQL source - without the "superuser" role certification
Azure Database for MySQL Flexible Server - Source & Target Certification
MariaDB 10.6 to 10.11 versions on MySQL - certification
MariaDB 10.6 version on Amazon RDS - certification
Troubleshooting tips
Analyze Qlik Replicate Logs
An evergreen pair of articles helps you read and analyze Qlik Replicate log files:
How to analyze a Qlik Replicate logList of the error types in Qlik Replicate
Qlik Data Integration Product End of Life Versions
Qlik Release
Qlik Replicate / Enterprise Manager
End of Support Date
Qlik Compose
End of Support Date
February 2021
November 2020 SR1
November 2022
February 2021
February 2023
May 2021
May 2021
May 2023
May 2021
May 2023
August 2021
May 2021 SR1
May 2023
August 2021
August 2023
November 2021
November 2021
November 2023
November 2021
November 2023
For more information, see Qlik Product Lifecycles.
...View More
Edited August 30th, 15:55 CET: Added clarification on older Qlik Sense Enterprise on Windows versionsEdited August 31st, 13:10 CET: Added clarification on possible workarounds (none exist) as well as information regarding what authentication methods (all) are affected and that HTTPandHTTPS are impactedEdited November 21st, 8:40 CET: Added clarification to apply thelatestpatches
Hello Qlik Users,
Two security issues in Qlik Sense Enterprise for Windows have been identified and patches made available. Details can be found in Security Bulletin Critical Security fixes for Qlik Sense Enterprise for Windows (CVE-2023-41266, CVE-2023-41265).
This announcement from August 2023 and the mentioned releases only cover CVE-2023-41266 and CVE-2023-41265. Apply the most recent patches as documented in Critical Security fixes for Qlik Sense Enterprise for Windows (CVE-2023-48365)(September 2023), which resolve CVE-2023-48365 as well.
Today, we have released five service releases across the latest versions of Qlik Sense to patch the reported issues. All versions of Qlik Sense Enterprise for Windows prior to and including these releases are impacted:
May 2023 Patch 3
February 2023 Patch 7
November 2022 Patch 10
August 2022 Patch 12
All prior versions of Qlik Sense Enterprise on Windows are affected, including releases such as May 2022, February 2022, and earlier. While no patches are currently listed for these versions, Qlik is actively investigating the possibility of patching older releases.
No workarounds can be provided. Customers should upgrade Qlik Sense Enterprise for Windows to a version containing fixes for these issues. August 2023 IR released today already contains the fix.
August 2023 Initial Release
May 2023 Patch 4
February 2023 Patch 8
November 2022 Patch 11
August 2022 Patch 13
This issue only impacts Qlik Sense Enterprise for Windows. Other Qlik products including Qlik Cloud and QlikView are NOT impacted.
All Qlik software can be downloaded from our official Qlik Download page (customer login required). Follow best practices when upgrading Qlik Sense.
The information in this post and Security Bulletin Critical Security fixes for Qlik Sense Enterprise for Windows (CVE-2023-41266, CVE-2023-41265)are disclosed in accordance with our published Security and Vulnerability Policy.
Clarifications and Frequently Asked Questions:
What can be done to mitigate the issue?
No mitigation can be provided. An upgrade should be performed at the earliest. As per Qlik's best practices, the proxy should not be exposed to the public internet, which reduces theattack surface significantly.
What authentication methods are affected?
All authentication methods are affected.
Are environments with HTTP disabled impacted?
Environments will be affected regardless if HTTP or HTTPS are in use. These vulnerabilities affect the HTTP protocol overall, meaning even if HTTP is disabled, the environment remains vulnerable.
These attacks don’t rely on intercepting any communication, and therefore, are indifferent whether the HTTP communication is encrypted or not.
Kind regards, and thank you for choosing Qlik,
Qlik Global Support
...View More
We are pleased to announce new capacity model pricing for Qlik Analytics. The new pricing model is an extension of the capacity functionality we introduced earlier this year for data integration.
We believe this pricing model aligns with modern customer expectations and will:
Provide more predictability as you plan deployments
Make it easier to take advantage of available capabilities in Qlik Cloud
Give more flexibility to organizations wanting to expand analytics usage
Today, we offer three capacity pricing tiers: Standard, Premium, and Enterprise.
You can find additional details on our website Qlik Cloud® Analytics Plans & Pricing
With the Qlik Cloud capacity model, the primary value meter is Data for Analysis or Data Moved, except for Qlik Cloud Analytics Standard where Full Users is the value meter.
See in detail what it means here: Subscription value meters
Additionally, we understand the importance of Qlik Cloud administrators to monitor their tenants' data consumption. Therefore, we are pleased to introduce:
A monitoring dashboardLocated in the home pane of the Management Console, this overview provides a summary of user allocations, data capacity consumption, reports, and other capacity-based resources to understand your usage.
A specialized Qlik Sense ApplicationFor more in-depth analysis, a detailed consumption report is delivered in a Qlik Sense Application allowing you to further understand how your organization uses Qlik Cloud.For more information on how to deploy the report, please see our Qlik Help for details: Monitoring usage with detailed consumption reports.
Additional resources:
Capacity Pricing and Usage Telemetry in Qlik Cloud available
Qlik Cloud® Analytics Plans & Pricing
Qlik Cloud Analytics specifications and capacity
Subscription value meters
Monitoring resource consumption
Monitoring usage with detailed consumption reports
Thanks for choosing Qlik!
Qlik Global Support
...View More
Qlik Data Gateways Upgrade is Required by September 15
Due to planned certificate maintenance in Qlik Cloud, customers must upgrade their Data Gateway installations by September 15.
If you are on version 1.3.2 or earlier, you must upgrade to the latest major version to continue using the Direct Access gateway by September 15.
Setting up Qlik Data Gateway - Direct Access | Qlik Cloud Help
To continue using the Data Movement gateway, customers must upgrade to the latest version2022.11.74.Please see the documentation below for more details on upgrading:
Direct Access gateway upgrade instructions
Data Movement gateway upgrade instructions
Please contact Qlik Support if you have any issues with the upgrade:How to Contact Qlik Support
...View More
Hello Qlik users,
We want to inform you about upcoming weekend maintenance (August 11th, 2023, at 1 pm ET/5 pm GMT to August 14th, 2023 at 1 am ET/5 am GMT.
Please note that during this period, there will be a brief impact on the ability of new customer accounts to access the community support spaces and create cases for critical issues.
Existing Customers Unaffected:
We want to reassure our existing customers that this maintenance will not affect your ability to create cases. You can continue to access our support services without interruption.
Please also be aware that automated emails will be turned off for this period for all customers, so you may not receive automated updates on your cases. Please be patient as our engineers will try to reach out you manually by phone or by their personal email.
Assistance During Maintenance:
If you are a new customer needing urgent support during this maintenance window, please reach out directly to our support team at Support@qlik.com. We understand the importance of addressing critical issues promptly and are here to assist you.
We appreciate your understanding and patience as we work to bring you an even better Qlik experience.
Best,
Qlik Global Support
...View More
Welcome to Qlik, we’re excited to have you onboard and can’t wait to see how our solutions will help achieve your data and analytics goals.
Ready to take the first step? Start Here!
We’ve gathered the essential resources for you to follow and set up your own tenant along the way. With comprehensive implementation steps, a Go Live Checklist, and training recommendations for your end users, we’ll guide you through getting your environment up and running for your organization.
Log into Qlik Continuous Classroom with your Qlik Account to access this free, curated onboarding content for Qlik Cloud Admins.
If you need help as you get started, chat with our Support Engineers 24/5.
Happy learning!
Qlik Customer Success
...View More
Don't miss our previous Q&A with Qlik! Pull up a chair and chat with our panel of experts to help you get the most out of your Qlik experience.
Let our Qlik experts help you navigate and better understand how to get started finding data insights with Qlik Cloud. We discussed where to find things, how to load data, easy ways to start building apps and share your discoveries.
SEE THE RECORDING HERE
Qlik Global Support
...View More
This is our second monthly Qlik Data Integration newsletter. Each month, we cover one endpoint and share our top resources, best practices, release updates and upcoming webinars.
Subscribe to theQlikData Integrationtopic to be notified of future editions!
Index
Resource HighlightsWebinarsKnowledgebase ArticlesRetiring Qlik Replicate EndpointsAnalyze Qlik Replicate LogsEndpoint Spotlight: SQL ServerNew Issues ReportedTips!Release UpdatesFixesEnhancementsNew ReleasesQlik Data Integration Product End of Life Versions
Resource Highlights
Webinars
(Update) Book your calendar for the upcoming Q&A with Qlik: New to Qlik CloudQ&A sessionscheduled forAugust 15th at 10:00 AM EDT. It is a live Q&A session with a panel of Qlik experts. Bring your questions, and we do our best to answer them.
Explore Qlik Support's recorded Techspert webinar series on-demand or visit ourYouTube Channelto discover more!
Techspert Talks
Q&A with Qlik
Knowledgebase Articles
Retiring Qlik Replicate Endpoints
As of July 31st, 2023, the following endpoints will be retired:
Source Endpoints:
HP Non-Stop Source
Open VMS RMS Source
Hadoop Source
Target Endpoints:
MapR Target
MapR Streams Target
MS APS PDW Target
SAP Sybase IQ Target
HP Vertica Target
Actian Vector Target
Netezza Target
Pivotal Greenplum Target
SeeRetirement for Specific Qlik Replicate Endpointsfor details.
Analyze Qlik Replicate Logs
An evergreen pair of articles helps you read and analyze Qlik Replicate log files:
How to analyze a Qlik Replicate logList of the error types in Qlik Replicate
Endpoint Spotlight: SQL Server
Find our latest knowledge base articles for SQL Server endpoints.
New Issues Reported
Qlik Replicate Task logs a warning: ]W: MS-REPLICATION is not enabled for table
Find the resolution inQlik Replicate Task logs a warning: ]W: MS-REPLICATION is not enabled for table.
Qlik Replicate: [SQL Server]Login failed
The behavior began after an upgrade to Qlik Replicate version 2022.11 or later.Find the resolution inQlik Replicate: [SQL Server]Login failed after an upgrade to Qlik Replicate 2022.11 or later.
Tips!
Qlik Replicate Red Hat 8 SQL Server Source fails TCP Provider: Error code 0x2746
Qlik Replicate 2022.5 fails to connect to SQL Server Source Endpoint when connecting from Red Had Linux 8 using the libmsodbcsql-17.10.so.1.1 or libmsodbcsql-17.6.so.1.1. Qlik Replicate Red Hat 8 SQL Server Source fails TCP Provider: Error code 0x2746for details.
Qlik Replicate: SQL Server idle connections closed
Inactive TCP/IP connections to SQL Server can sometimes be closed by your router or firewall. This will give your task a recoverable environmental error. Parameters in the Windows Registry can be set to send transmissions for the connection to keep it active. For more information, seeQlik Replicate: SQL Server idle connections force closed.
Best Practice:Qlik Replicate: SQL replication jobs
If you use a non-sysadmin account to replicate data from SQL Source, then the DBA must update the owner of all SQL Server jobs belonging to ‘REPL%’ category to the SA account.Qlik Replicate will not create or manage any of the SQL Agent jobs.
Best Practice:SQL Server Source - Rebuild Index Best Practices and Recommendations
Release Updates
Fixes
Qlik Replicate May 2023 SP1
Type: Issue
Component/Process: Microsoft Azure SQL (MS-CDC) and Microsoft SQL Server (MS-CDC) targets
Description: The task would fail when DB_ID() returned a different value than database_id in sys.databases. The issue was resolved using an internal parameter.
Type: Issue
Component/Process: Microsoft SQL Server Source
Description: An online transaction log is read sometimes slow, add an internal property to control the number of rows being read in one request.
Type: Issue
Component/Process: SQL Server Source
Description: sp_repldone truncation prevention does not work with specific collation
Type: Issue
Component/Process: Transformation
Description: A transformation expression that separates keywords by a new line, cannot be executed causing SQLite errors.
Type: Issue
Component/Process: MySql Source
Description: When NOT NULL column is defined as AUTOINCREMENTED, it is exposes as NULLABLE.
Type: Issue
Component/Process: MySQL Source
Description: When replicating a high volume of data, starting the task or retrieving the table list would take an excessively long time or get stuck. The issue was resolved using an internal parameter.
Enhancements
Qlik Replicate August 2023 SR
New Confluence Endpoint (based on Kafka)
Qlik Replicate November 2023 IR
Expose stream buffer tuning parameters in task settings as per ideation request:Replicate & QEM - Expose stream buffer tuning parameters in task settings
Confluent Schema Register using BOTH authentication methods (Public Key + Username & password)
MariaDB new version certifications
New Releases
(Updated) Available on the Download Page
Qlik Replicate 2022.11 SP06
Qlik Enterprise Manager 2022.11 SP06
Qlik Data Integration Product End of Life Versions
Qlik Release
Qlik Replicate / Enterprise Manager
End of Support Date
Qlik Compose
End of Support Date
February 2021
November 2020 SR1
November 2022
February 2021
February 2023
May 2021
May 2021
May 2023
May 2021
May 2023
August 2021
May 2021 SR1
May 2023
August 2021
August 2023
November 2021
November 2021
November 2023
November 2021
November 2023
For more information, see Qlik Product Lifecycles.
...View More
We are pleased to introduce the first major launch of over 20 connectors for Qlik Cloud Data Integration enabling you to leverage both full and incremental data load from these popular Cloud Application sources.
For this release you will find below connectors made available to you:
Adobe Analytics
Oracle Netsuite
Shopify
Coupa
Pendo
SuccessFactors
Google 360 Analytics V4
Percipio (Skillsoft)
Sugar CRM
Jira
Qualtrics
SurveyMonkey
Marketo
Salesforce
Twitter
Microsoft Dynamic 365 CRM
SAP Concur
WorkDay
Microsoft Azure Active Directory
ServiceNow
Zuora
How to start using the feature:
These connectors will be tagged as Preview and access will need to be requested via your Qlik Customer Success Manager or Qlik Support providing your tenant details and the connectors you are interested in using.
A requirement is to have set-up Data Gateway - Data Movement. For more information, see Qlik Data Gateway - Data Movement overview.
Once this is done you will need to:
Connect to a SaaS application.
Select your processing (Reload and Compare vs Change Data Capture).
Scan the data for metadata generation.
Add datasets to the metadata.
Reload metadata
More detailed instructions are available on our help site.
Additional resources:
SaaS in 60 - New Cloud Application Sources in Qlik Cloud Data Integration (Video)
Walkthrough: Cloud Application Sources - Qlik Cloud Data Integration (Video)
Thanks for choosing Qlik!
Qlik Global Support
...View More