February 2022 is not only the month where two dates can be represented with just the number "2" (2/2/22 and 2/22/22 or 22/2/22), but it's also when Qlik is delivering its first 2022 release of Qlik Data Integration. Customers can take advantage of new capabilities related to data lake creation, improved warehouse automation, security updates, and source endpoint enhancements.
First and foremost, we have resolved all known log4j critical vulnerabilities across the Qlik Data Integration portfolio and have updated the log4j library to the more secure version 2.16.
Let's start with data lakes.
We've simplified the creation process by allowing users to customize the handling of deleted records in data lake projects. When users delete records in the storage zone of the data lake, they are soft deleted by changing their status to deleted. While this operation provides the ability to understand when deletes have occurred, it is not appropriate for certain types of analyses. The user can now configure the current view of data (i.e., ODS view) to include or exclude deleted records. This flexibility to contain or exclude deleted information makes analytics applications more customizable to the context of the analysis and insights sought.
Second, we've made improvements to data warehouse automation.
Uniform source consolidations. Using traditional approaches to data warehousing, loading multiple source systems with identical structures (including table or view names, column names, and data types) to the target data warehouse is a maintenance nightmare. But Qlik users can now standardize and reuse mappings across multiple landing areas with identical structures. These mappings can include filters, data quality, and data validation rules. Users can flexibly create a single task across all sources or group sources across multiple tasks by reusing mappings. This standardization allows greater automation of generated code, resulting in increased productivity and reduced maintenance costs.
Naming templates. Naming schema can vary for different deployment environments leading to error-prone and time-consuming manual changes. Qlik users can now use predefined environment variables to streamline the naming of artifacts such as data warehouse connection information, landing information, data marts, and lookups. These template variables will reduce deployment friction by making code more portable and improving developer efficiency.
Next, let's talk about CDC Streaming
We've added more capabilities to several Source Endpoints, including:
SAP HANA – We have optimized memory usage, and we've added auto-detection of SAP HANA versions to improve the support experience.
Microsoft MySQL Server – We now offer support for nulls as the primary key to help Qlik better align with current structures such as the Data Lakehouse.
IBM DB2 for z/OS – We have added bidirectional replication support for mainframe databases that do not produce an event when updating a record with the same values.
Oracle – We're now capturing more logging details about the Oracle instance configuration to improve support.
Salesforce - In case of transient slowdowns in network traffic, we've added a new parameter that will write Salesforce batches to intermediate files before sending them to the target endpoint.
Regarding Qlik Enterprise Manager, we've increased the granularity rate of purging old log files to allow for an hourly frequency. And we’ve also added a new Qlik Sense application in the Community that significantly expands the capabilities of Qlik Enterprise Manager Analytics.
And finally, we've added new capabilities to Qlik Catalog
Administrators can now import and export business metadata to maintain or backup business metadata offline.
We have expanded Qlik Catalog public APIs to include security-related transactions. These new public APIs will allow Qlik Catalog customers to develop integrations with third-party security systems that could automatically add, modify or remove users and groups and manage users within a group.
Together, the February 2022 release of Qlik Data Integration offers many new capabilities to help our customers turn raw data into actionable data. And we'll continue to develop more Qlik Data Integration product enhancements to bolster our Qlik Active Intelligence Platform – an end-to-end real-time data integration and analytics cloud platform.
Want to try out this release? Go to support> Downloads on Qlik.com and filter for the product you want to download
Want to try out this release? Go to support> Downloads on Qlik.com and filter for the product you want to download:
Qlik Compose (2021.8 SR3, i.e., 2021.8.0.465)
Qlik Replicate (2021.11.0.193)
Qlik Enterprise Manager (SR1 / 2021.11.0.198)
Qlik Catalog (February 2022)
And if you're interested in hearing about how Data Warehouse Automation can deliver a more significant ROI for your analytics data pipelines, register for this webinar.