With Qlik APIs, software partners and customers develop third-party extensions in several areas to enhance our data analytics platform. Visualization extensions deliver great value to end-users because they enable visual storytelling in a more compelling way, and compliment standard visualizations that come out of the box. With the February 2020 release of Qlik, our customers in the cloud can benefit from visualization extensions in all SaaS editions of Qlik Sense.
Developers have contributed over 700 projects to our open-source repository of reusable components, Qlik Branch. Some of the most commonly found extensions are visualization extensions. Uploading them to Qlik Sense Enterprise for Windows or SaaS editions of Qlik Sense is a snap through the interface of the extension in the management console. Other extensions focus on automating back-end operations like reloads and task management, monitoring, and governance. And a new class of extension, analytics connectors, are emerging with AI and machine-learning capabilities. These server-side extensions (SSE) allow Qlik’s unique data engine to communicate with models written in R, Python, and others to perform data science activities. OEM partner MSL Solutions link uses Qlik’s APIs and an SSE to connect to R in their hospitality offerings.
Visualization extensions are the first phase of extensibility available in SaaS editions of Qlik Sense. If you want to find, explore and learn more about extensions to add to your Qlik instance, developer.qlik.com is your go-to destination. While many visualization extensions are open source and community-supported, several Qlik partners are members of TED, our trusted extension developer program where partners submit their solutions within a certification process. This process includes testing the extension against versions of Qlik Sense for stability and security before receiving the trusted extension developer badge. An important point to keep in mind is support for extensions is the responsibility of the extension author. Qlik supports the APIs extension developers use to make and surface their solutions. If you are ready to go and want to install an extension in a SaaS edition of Qlik Sense – watch the video
Different extensions are usable today in Qlik Sense Enterprise for Windows and now with the February 2020 release, developers will be able to use visualization extensions in all SaaS editions of Qlik Sense.
Qlik offers one of the most robust and proven set of APIs of any analytics vendor in Gartner’s Magic Quadrant for BI, learn more about our APIs here.
Are you a developer? Start your journey at developer.qlik.com and learn all about extending and integrating analytics in your applications today.
Sr Product Manager
As part of our drive to lead in the cloud, the February release adds the ability to use third-party visualization extensions in our SaaS offerings. The ability to include extensions fromTrusted Extension Developersand thewider development community, now greatly increases the ability to customize analytics in our SaaS products. We have also added 4 new data connectors, the ability to export to pdf and have made numerous improvements to the management of tenants, all of which drive improved insight to action in the cloud.
Another key focus area for us in 2020 is strengthening our strategic technology partnerships and the value of our integrated offerings. With the February 2020 release, we are introducingDynamic Views (video)which gives Qlik Sense users the ability to refresh data within one or more charts in an on-demand fashion. This allows users to maximize system performance by enabling precision data source access while empowering users to be in control of when data is refreshed in an app. This provides flexibility in how customers manage data and the associated costs, while also enriching our partnership with cloud data platforms like Snowflake.
The value of our end-to-end data and analytics platform is akey part of differentiation for Qlik, and in 2020 we aim to strengthen the integration between our platforms, creating an unrivaled value proposition for customers. A key step in this process is the introduction of an integratedQlik Data Catalyst QVD Catalogin Qlik Sense. Qlik Sense users can now browse and select QVD based data sources from directly within the Qlik Sense user interface. (Qlik Data Catalyst for QVDS - video)
We continue to respond to customer and partner feedback, and as such, we are pleased to announce that this release addsover 10 new data visualization features and styling optionsto Qlik Sense, allowing users to create more advanced and customized analytics. We have added trendlines, indicators in tables, moving average and difference modifiers, custom tooltips, and a duplicate function for measures. New styling options include dimension, header and cell options for pivot tables, a new action button with improved styling, line options for the line chart, custom sorting in the funnel chart, and font family support in custom themes. And we have made improvements to mapping functionality and presentation. With these features, we continue to expand the quality and power of the visualization and dashboarding capabilities in Qlik Sense.
We also continue to enrich our leadership position in augmented and conversational analytics by making several improvements to our visual insight generation capabilities in Qlik Sense, driven by the Qlik Cognitive Engine. We have added support for Radar Charts, allowing our cognitive engine to automatically generate this type of visualization. And we have improved pattern detection for natural language processing (NLP), as well as made natural language search available in Qlik Sense on Windows. These capabilities help improve the quality and relevance of AI-generated insight suggestions in Qlik Sense.
The release also includes improvements to several value-added products. For Qlik Insight Bot, we have added new capabilities and reduced back-end dependencies for seamless installation and operation. This includes the ability to use bookmarks in conversational interaction, manage with multiple administrators, and synchronize users between Qlik Sense and Qlik Insight Bot. And for Qlik NPrinting, we have delivered improved licensing operations and a streamlined approach for report authoring allowing quick reports to be created from charts and sheets. Also, this release makes it easier to manage situations where the Qlik Sense app ID is changing due to publish/replace and movement between environments.
With all of this, plus back end improvements around performance and security measures, The February 2020 release continues to drive our innovation agenda around accelerating business value through data and analytics and helps get 2020 off to a fast start.
Check out the What's New demo App, and be sure to register for the Qlik Insider to hear from our team of experts on this release.
Feature Demonstration Video
Qlik Data Catalyst for QVDs
Third-party visualization extensions in cloud-based editions
We already offer a tight integration between Qlik Sense and Qlik Data Catalyst, especially around the organization of QVD files. Now you can integrate Qlik Data Catalyst with the cloud editions of Qlik Sense. Directly loading on-premises data into a cloud edition of Qlik Sense is typically not allowed by a customer's IT department due to security concerns. Qlik Data Catalyst is now able to offer two new capabilities to address this issue:
1. The Publish capability has been expanded to allow users to automatically and securely publish data to a QCS Landing Zone (an S3 bucket). Data is delivered in the QVD file format except for Sample and Profile data which is delivered in the JSON format. Cloud users can then browse and consume data using their existing Qlik S3 Connector. This capability includes the ability to maintain obfuscation of sensitive data.
Dataset that was transferred by Qlik Data Catalyst into a cloud edition of Qlik Sense
2. Alternatively, a Qlik Data Catalyst user can publish data on-demand to cloud editions of Qlik Sense by selecting a new Publish to my QCS option in the Take Action menu.
This release also marks an important first step in elevating Qlik Data Catalyst to be a full member of the Qlik Kubernetes-based ecosystem as Qlik Data Catalyst December 2019 is additionally packaged as a set of Docker Containers. We plan on integrating modules of Qlik Data Catalyst more fully into the Kubernetes environment in future releases.
Finally, for Qlik Sense users, Qlik Data Catalyst December 2019 includes important new QVD-related usability improvements including the automatic scheduling of QVD incremental loads, displaying QVD Qlik lineage and performance enhancements.
Schedule automatic, recurring synchronization of QVD filesView QVD lineage including source file
Join us in the Qlik Community to be part of the conversation on how Qlik Data Catalyst will interact with Qlik Sense as well as what we're planning to do at Qlik World.
New this year: we want to increase engagement with those who are attending and give those who are considering attending an area to interact with peers, sponsors and the Qlik team. To this end, we are launching a new Qlik Community space dedicated to QlikWorld – Introducing the QlikWorld Forum!
This is a new space dedicated to all things QlikWord, to give you the opportunity to interact with customers, partners and Qlik experts on event-related content. Chat with our team of experts on how Qlik helps enterprises move faster, work smarter, and lead with data. This QlikWorld Community forum will give you an inside look into sessions that will be featured at the event, to help you understand how Qlik provides an open-ended and curiosity-driven exploration platform, giving everyone – at any skill level, the ability to make real discoveries that lead to real outcomes and transformative changes.
Get informed on some of the key topics and themes that will be featured throughout the event to help you understand more about the latest innovations and where Qlik is heading next. The forum will drive conversations around key themes, such as: managed data lakes, data warehouse modernization, cdc streaming, our platform - the technology and underlying architecture, and the strategy around our cloud and SaaS offerings. We will also cover topics specific to governed self-service, augmented and embedded analytics, the modernization of BI and how Qlik drives Data literacy for all. All this and more!
Get connected, be involved and share your biggest and boldest ideas with some of Qlik’s passionate data and analytics experts. This forum is sure to get you energized and ready for Qlik’s largest customer and partner event of the year.
Check it out, join in and start a discussion!
This feature can be found in My Qlik, another recently added tool that provides a single location for users to manage their Qlik identity and their Qlik Sense subscriptions. As part of this management, users can now associate a Partner ID with their subscription.
The Partner ID is a six-digit number that uniquely identifies a partner to Qlik. To associate the Partner ID to your subscription, the first step is to talk to your Partner and ask them what number you should use. Once you have that number, you can log into My Qlik (https://myqlik.qlik.com/portal/). Then, by clicking on the Subscriptions tab, you will be able to see your subscriptions.
Within the subscription tile you can click on the edit button and add the Partner ID.
If a Partner ID has already been entered, you can also change it, or delete it entirely.
It’s all about improving your experience with Qlik! The My Qlik Portal is an area where Qlik Sense users will have the ability to digitally purchase and manageQlik Sense BusinessSubscriptions and their own information among many other things.
More to come in the near future around the My Qlik Portal - stay tuned!
Qlik Insider webinar content is shared after airing on the Qlik Product Spotlightwhere you can access a host of other popular product-specific on-demand webinars and demo videos. We encourage you to take advantage ofQlik Product Spotlight, as it will help you stay informed on all of the exciting things that are possible with Qlik product portfolio.
As always each Qlik Insider webinar has a live Q&A panel giving you access to our team of experts and just as we did for the third Qlik Insider session, we’d like to share an overview of the hot ticket items that our audience had questions on.
The Q4 Qlik Insider webinar focused on the two most recent updates – September 2019 and November 2019: https://community.qlik.com/t5/Qlik-Sense-Enterprise-Documents/New-to-Qlik-Sense-Topics-You-Need-to-Know/ta-p/1530582
Once more, I used my Qlik Sense app to help me consolidate all the questions received from across each of the regional webinars (Americas, Asia Pacific and EMEA). Fun Fact: we had a 35% increase in the total number of questions from the Q3 webinar.
New Data Visualization Enhancements
Qlik Sense November 2019 release saw the introduction of a new native data visualization object, the Mekko Chart, also known by other names such as Marimekko chart, Mosaic plot or Mondrian diagram and is commonly used in finance and marketing use cases.
And we had great feedback on the further functionality improvements over the last two releases;
Table styling - more control when creating tables, change font sizes and color in headers and cells.
Accumulated measures in graphs - Now it’s as simple as ticking a checkbox option to accumulate measures in Bar Chart, Line Chart, Combo chart and Tables rather than writing expressions (which you can also still do – whatever works best for you)
Increased search limit on Filter Panes, we have increased the search limit from 255 characters to 5,000 characters, allowing more values to be selected in bulk.
Trellis container now supports two dimensions, for more details on using Trellis containers please see this design blog and video
We also received questions on the availability of more data visualizations, we are continually working on improving and bringing new visualizations with each release. One example is around the use of a Sunburst chart, which although is not native functionality, however, our Pie Chart has an option to create radius dimensions which mimics a sunburst– read more details on this, in Qlik online help
If you have ideas for future improvements – you can submit them to Qlik Product team on the Qlik community - Qlik Sense Ideas
QlikView – The love for QlikView is still strong and as a QlikView customer it’s your choice whether you stay with QlikView, deploy Qlik Sense alongside your QlikView environment or migrate to Qlik Sense entirely. Whichever path you choose we want your experience to be as smooth as possible.
One of the latest updates that was particularly liked is the ability to upload QlikView apps to Qlik Sense Cloud hub, either by using Qlik Sense Enterprise when it is deployed on Kubernetes or on Qlik Cloud Services which you can choose to do as part of your subscription. Right now, the ability to upload QlikView apps is available only through the cloud editions of Qlik Sense and is a manual process. Automation will appear in the next phase and we are looking to add support to Windows in 2020 - so keep watching for updates on this exciting capability.
Qlik Data Catalystfor QVDs - Qlik Data Catalyst is a game-changer in democratizing data within your organization helping you solve your data integration challenges of making raw data available as business-ready analytic data to all your users. With Qlik Data Catalyst your users can shop for data in enterprise-wide governed data catalogs and feed it into any other BI tool of their choice, yes that’s right, not just QlikView and Qlik Sense! In this session we showed a new product specifically for managing your QVD files with Qlik Data Catalyst for QVD.
Check out the QVD File Organization datasheet for more details on Qlik Data Catalyst for QVDs.
NPrinting – The Qlik NPrinting team continues to work hard improving Qlik NPrinting based on your feedback. Qlik NPrinting November 2019 release saw the availability of the Qlik NPrinting Migration Tool that you can use to convert your QlikView NPrinting 16.3 projects to new apps compatible with Qlik NPrinting 2019 or newer. The tool is built-in and for more details of the tool including what is and is not supported please see the Qlik NPrinting Migration Tool FAQ and the new section on Qlik online help which includes a useful video. As a reminder, QlikView NPrinting 16 end of support is scheduled March 31, 2020.
Multi-Cloud Strategy – Qlik’s multi-cloud capabilities support any use case regardless of where your data is stored or how the Qlik platform is deployed. We want to enable your cloud strategies by giving you the choice in how you deploy your analytics solution and evolve it to include more cloud services at your own pace.
Qlik Sense Business is our recent cloud edition of Qlik Sense, and is our current SaaS offering which essentially offers the same features as those found in Qlik Sense Enterprise – Our cloud editions run on a continuous delivery cycle, with extensions most recently supported. While there are no limits on the number of measures and dimensions for apps in Qlik Sense Business, there are however capacity limits as with any SaaS offering. You can find more details here https://www.qlik.com/us/pricing
As part of our cloud-first strategy, we have built our own Qlik Cloud Services where you can run our cloud editions on. This isn’t something that you buy but it’s the important stuff running behind the scenes. Qlik Sense Business is the first SaaS offering running on Qlik Cloud Services and you can try it for free on a trial basis.
Also, if you have an existing subscription of Qlik Sense Enterprise on Windows and want to try cloud you can extend your deployment by connecting to our Qlik Cloud Services as part of your subscription, contact your sales rep for more details.
Stay tuned for further developments on what else can be achieved with our Qlik Cloud Services.
This new cloud-native scalable architecture offers many benefits over the previous architecture that Qlik Sense Basic and Qlik Sense Cloud Business were built upon which is why Qlik Sense Business has replaced these earlier SaaS editions.
Another point to note is that Qlik Sense Business is the same architecture as Qlik Sense Enterprise on Kubernetes which is what you would use to deploy in your own cloud of choice. Both these cloud editions of Qlik Sense allow you to take advantage of new ways of working; the new cloud hub, a new paradigm for collaboration & using “spaces” along with governed management and administration capabilities.
This led to a few questions on what exactly is kubernetes, why use Kubernetes and where can I deploy it?. Kubernetes is a cross platform cloud scalable orchestration architecture, for more details check out https://kubernetes.io/. You can also read our whitepaper on the business value of Containers & Kubernetes and you can deploy Qlik Sense Enterprise on Kubernetes in your own private cloud infrastructure or on a major public cloud vendor such as AWS or redshift. See our technology page for more details
One important aspect of using cloud is security, which is where the use of an IDentity Provider (IDP) is strongly advised to manage authentication of your user base. The good news is that you can have your Qlik environment use Auth0 or Okta for example as an identity provider. Both Qlik Cloud Services and Qlik Sense Enterprise on Kubernetes integrate with an IdP using the OpenID Connect (OIDC)standard.
Natural Language Analytics – We also talked about a new NLP (natural language processing) capability in the Qlik Cognitive Engine that supports natural language search and interaction in Qlik Sense. As users engage with Insight Advisor, they are now able to enter search criteria using full natural language. Currently, NLP is available in English on Qlik Sense Enterprise on Cloud Services or Kubernetes and Qlik Sense Business.Please see the online help page for details. Going forward, natural language interaction will be available in other areas of Qlik Sense as well.
Data Integration Platform – when Attunity joined the Qlik group we become the only vendor to truly offer a full end-to-end platform for the data and analytics supply chain. Data Integration is about enabling DataOps for analytics, taking raw data and making it available as business ready at enterprise scale so it can be used for Data Analytics throughout the entire organization. Qlik’s Data Integration platform covers solutions for Database replication, Data Warehouse automation, and Data Lake Automation - all available on subscription, for more details on check out our Data Integration products page
Qlik Insight Bot – Qlik Insight Bot offers a fast and easy way to ask questions and discover insights also using natural language. It’s available right in Qlik Sense and through popular tools such as Slack, Skype, and Microsoft Teams for more details check out Qlik Insights bot online help page
Accessibility – we received a few questions on how Qlik is working to meet accessibility standards, please visit our Accessibility page.
Advanced Analytics – Did you know you can integrate Qlik into systems like R, Python and DataRobot and so many others? This really extends the possibilities with Advanced Analytics such as Predictive analytics. Please contact your sales rep to discuss your requirements. Also, Qlik Community is a great resource. https://community.qlik.com/
Qlik Associative Big Data Index – Visually explore your biggest data sources using Qlik’s Associative engine. Several improvements were made with the latest release such as building and interacting with charts, an expanded set of expressions that can be used and workflow improvements to the management console. The data sources to be indexed need to be prepared in Parquet format. It was asked whether QVD files were supported to save loading into memory, the best method here would be to use On-Demand App Generation. More details on Qlik’s Big Data Index can be found on the product page.
Qlik Connectors – Qlik has a host of built-in connectors to varied data sources and APIs, most recently we added connectivity to Snowflake and enhanced the Salesforce connector to support recent API changes. Other interesting topics discussed in the chat were Data Encryption and Sentiment analysis
“Help, I need somebody”
We often get support questions on our webinars, but don’t wait until the next webinar if you need help. Most of the time you can find the answer you need on Qlik Community - for example, someone asked about creating different Financial years to suit various periods in Qlik Sense and the answer is out there. If you can’t get the resolution you need on Qlik Community and you need technical support then check out our Qlik Support portal where you can search the knowledge base just by asking a question; and as a paying customer, you can always submit a support request to get assistance from our superhero support team.
What’s new doc?
Well, that’s a wrap for the Qlik Insider webinar series for 2019, I hope to see you again in 2020.
Don’t forget we always produce a plethora of ‘what’s new” content for every new release of our products here on the Qlik Community, so you can always be in the know on the latest product enhancements and innovations. You can even get hands-on with the latest What’s New Qlik Sense demo app and learn some great tips and tricks in our “Getting Started with Qlik Sense” Webinar Series
For a great overview of all the releases of 2019 check out this post on Qlik Community which links to lots of great resources, such as the Qlik Continuous Classroom and the Qlik help site plus a whole host of tips and tricks too.
I’ll leave you with one last tip; If you are just getting started with Qlik, make sure your first step is through the onboarding experience.
Thanks for reading and enjoy the festive season!
- Adam Mayer, Senior Data Evangelist and Innovator at Qlik
The QlikB.I.onicBattle (emphasis on the BI) comes from the same talent that brought you theQlik IoT Race Game. Thisis a gamification concept to help folks better understand data in a fun way, or as one attendee put it;
"This is a great way to make data less scary"
We used standard IT technologies to build an IoT infrastructure along with 3D printed bots, whom we affectionally call theSTAToids.EachSTAToidwas controlled by attendees who competed against each other in an arena.
The idea for the Data Revolution Tour events was simple; in homage to theRugbyapp which was on at the time, attendees could score points by using theirSTAToidto push a ball into their opponent's goal. They could also try tipping their opponent over and win the game by a Knockout, which would score them more points- but they needed to be quick as the game is timed, which adds to the excitement.
What's data got to do with all this? Well, the arena was watched over by a 'Gods-eye' webcam whichused visual analytics totrack theSTAToidsevery movement. How? EachSTAToidhad aQRCodeso they could be individually identified and tied to the attendees who were playing.
Augmented Intelligence Challenge
All the movement data and points scored from goals and knockouts were collected as time series data and all fed into a Qlik Sense app to allow full exploration of the game data enabling attendees to draw out better game strategies for next time.
The Qlik Sense app was used to measureplayer's performance and allow discoveries of further insights.Details such as the total number of games played and points scored by eachSTAToidwere available at an aggregated level along witha Leaderboard of players ranked by points and Knockouts achieved. The movement flows of eachSTAToidwas also displayed using Qlik GeoAnalytics capabilities.
Watch this video for an overview:
You can alsowatch mediscuss the QlikB.I.onicBattle at the London Data Revolution Tour with our own John Sands onYouTubeor listen to the Qlik podcast onPodBean
The Future of Augmented Intelligence is bright!
This was only the first generation of theB.I.onicBattle format. The plan is to build on this experience and go much bigger and better atQlikWorld (formally Qonnections) in May of 2020.
We are looking at bringing in more games to testattendee’sskills andstrategies. We also want to experiment with Augmented Intelligence and build on the potential to have an A.I. controlledSTAToidsthat humans can pit their wits against. Predictive analytics might also be used to bring augmented intelligence to the challenge by using our Cognitive Engine to surface insights like best paths and strategies to take to win a game within the fastest amount of time.
But we don’t want to stop there - the QlikB.I.onicBattle was conceived from the beginning to be packaged up and shared amongst fellowQlikkiesand for our Partners around the globe to be used at their events.
Ultimately afterQlikWorldwe have plans to further invest in B.I.oinc Battles by leveraging Qlik Community and Qlik Branch to provide ways to make this as an open-source project so you too can get involved and create your own versions of the QlikB.I.onicBattle and apps.
More to come on Qlik's STATiods, and make sure to follow the evolution of this innovation in 2020!
- Adam Mayer, Senior Data Evangelist and Innovator at Qlik
We are pleased to release additional capability to the cloud editions of Qlik Sense this month – with some new and improved capabilities in following compositions: Qlik Sense Enterprise on Cloud Services, Qlik Sense Enterprise on Kubernetes and Qlik Sense Business Moving forward, in 2020 we plan to release more frequently to these editions, and we encourage you to follow the Product Innovation blog to ensure you stay informed on the latest product advancements.
This December release includes:
All cloud editions (Qlik Sense Business, Qlik Sense Enterprise on Cloud Services & on Kubernetes)
Direct all users to a single hub in Qlik Cloud Services, while still accessing content from multiple locations
Enhancements to the Visualization Bundle, with new sorting options in the Funnel chart
Qlik Geocoding is now available in GeoOperations
Dropbox load connectivity, with the ability to allow a data store of QVDs
Google Drive for file storage isnow available in Data Load Editor and in Add DataManager
Azure Blob file storage connector is now available in Data Load Editor and Add Data Manager
SSL support in REST connector – with the ability to connect to web based, and on-premise data sources, irrespective of deployment in support of our multi-cloud strategy
Expanded existing S3 connector to allow Store of QVDs
All SaaS editions (Qlik Sense Business and Qlik Sense Enterprise on Cloud Services)
API authentication mechanism for automating key actions in the platform
Import a batch of links to content into spaces using the Management Console
Ability to change/transfer owner of an app from one user to another to any user in the tenant
Qlik Sense Enterprise on Kubernetes
Qlik is introducing Dynamic Views which is the ability for users to have control over what and when data within a chart can be updated within an app. This new capability in Qlik Sense gives users the ability to refresh the data within one or more charts on-demand.
Check out these features by starting a trial of Qlik Sense Business
Simplified deployments… check! Lower infrastructure costs… check! Relief from entitlement management… check!
Thank you for your enthusiasm for QlikView year after year. As the Qlik offerings evolve, we want to make sure to keep you apprised of the latest news and developments. We invite you to join us for our latest Product Spotlight OnDemand webinar: “Protect and Extend Your QlikView Investment” for an update on QlikView, our strategy, and go forward plan.
During this webinar, product leadership will discuss Qlik direction and how our commitment to QlikView plays into the overall Qlik strategy and development trajectory. We will introduce the concept of product co-existence and how we’re making it simple and cost-effective to extend QlikView capabilities through Dual Use licensing. We will also introduce you to our roadmap and release plan, so you can gain insight into valuable and complementary updates recently added to Qlik Sense.
Visit this link to attend “Protect and Extend Your QlikView Investment”.
A big part of the value is integrating with many platforms. Things change – you might start your analytics on AWS, then try certain workloads on Azure and Google. Your company might acquire a business unit that runs production data on SQL Server rather than Oracle. Your CIO might institute a data modernization effort that requires you to offload analytics queries from your DB2 z/OS systems to Kafka. Whatever direction you take, it helps to have a consistent, automated data pipeline process.
Here at Attunity, now part of Qlik, we cast an ever-widening net with our pipeline automation. Attunity version 6.5 extends our leadership in enterprise data integration with enhanced platform support, performance and security capabilities, as well as additional platform configuration options for flexibility.
Platform Integration Leadership in Enterprise Data Integration
Attunity now integrates with new end points that organizations are embracing for both operations and analytics. We have added support for Salesforce, MongoDB and Google Cloud SQL as sources, and Google Cloud BigQuery, Azure Databricks (beta) and Azure Data Lake Storage (ADLS) Gen2 as targets.
Attunity Data Integration: Any Source to Any Target
Here are a few example use cases to see what this looks like in action.
Next-Generation Data Lakes: Enterprises are shifting from complex, Hadoop-based data lakes on premises to simpler, more scalable and more efficient data lakes based on cloud-native data stores and Apache Spark. Databricks is a prime target. With Attunity 6.5, you can now automatically create an operational data store in the Databricks Delta lake, then load, merge and format data in it from Salesforce and other sources – mainframe production systems, SAP SRM applications, you name it. Source data and schema updates are automatically propagated into the ODS. So your analytics are based on a current, accurate view of the business, spanning sales trends, customer activity, supply chain updates and more.
Multi-Cloud Initiatives: Many organizations are adopting a 2nd or even 3rd Cloud Service Provider in order to control cost, test one CSP’s advanced analytics tools, or reduce exposure to a CSP that is also a competitor. We continue to broaden our portfolio to flexibly support these decisions. With Attunity 6.5, you can migrate your data warehouse from Amazon Redshift to Google BigQuery, or migrate your database from Google Cloud SQL to Azure SQL DB.
We continue to reduce latency and increase throughput via deep integration with the most common enterprise platforms. Here is a look at the performance enhancements of Attunity Replicate 6.5.
Kafka Targets: We have significantly improved performance when using the Avro format to encode messages produced by the Kafka target.
Log Stream Targets: Replicate users now can adjust data compression levels with an intuitive slider. Higher compression levels conserve disk space, while lower compression reduces latency.
SQL Server Sources: Replicate has reduced latency by reading SQL Server Large Objects (LOBs) directly from transaction logs instead of performing a lookup.
Extended Parallel Load Support: This throughput-enhancing feature has been extended to the following endpoints:
Sources: Teradata and Amazon RDS for SQL Server
Targets: Azure Data Warehouse, and Snowflake on AWS and Azure
Target Change Processing: Replicate now can increase throughput by applying batched changes to multiple tables concurrently on Amazon Redshift and Microsoft Azure SQL Data Warehouse targets, in addition to previously-supported targets.
We have also improved our management flexibility, pushing out the envelope with new configuration options for some of our most popular sources:
SQL Server: Replicate now supports dynamic data masking, as well as non-sysadmin users configured with the Always On option.
Oracle: Reset log operations are now captured by default, and Replicate can detect open transactions on all RAC nodes rather than just the primary node.
SAP HANA: Users now can:
Replicate from both single and multi-tenant architectures on a single host.
Replicate partition tables and header columns with log-based CDC.
Finally, Attunity 6.5 hardens security controls on a number of fronts to ensure data integrity and support compliance efforts across all platforms. For example, Attunity Replicate now includes a Secure Sockets Layer (SSL) option to encrypt client-server connections for email notifications. This SSL capability also includes the ability to verify “peer” and “host” fields by validating server certificates. We also have added non-privileged accounts on Windows, enabling users to run Replicate with restricted capabilities compared with the default account. Finally, new installations now require strong passwords.
To download the software and try it for yourself, check out the Attunity Replicate Test Drive.
Article by Kevin Petrie
Product Marketing Director
Check out this video to see it in action: