Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello,
I’ve configured a Log Stream task to read from a Microsoft Azure SQL database, along with a replication task that reads from this Log Stream and replicates data to a Databricks Lakehouse (Delta) endpoint.
Among the replicated tables, there is one with about 380 million records and 18 columns, which accumulates between 200,000 and 400,000 changes during the full load, which typically takes several hours.
Over the past few weeks, once the full load of this table completes, the task has been unable to apply the changes to Databricks. Specifically, the task tries to apply the DELETE operations on the table and remains in running state for tens of hours without completing the operation successfully.
The DELETE operation has this form:
DELETE FROM my_database.target_table T
WHERE EXISTS (
SELECT C.seg1
FROM my_database.attrep_changes_table C
WHERE (
T.primary_key = CAST(C.seg1 AS INT)
OR (T.primary_key IS NULL AND C.seg1 IS NULL)
)
AND C.seq >= 1
AND C.seq <= 200100
);We have tried several alternatives to solve the problem, including:
Unfortunately, none of these attempts was successful.
However, we verified that the following DELETE operation runs in 30 seconds on Databricks:
DELETE FROM my_database.target_table
WHERE primary_key IN (
SELECT CAST(seg1 AS INT)
FROM my_database.attrep_changes_table
WHERE seq BETWEEN 1 AND 200100
AND seg1 IS NOT NULL
);Is it possible to configure the replication task to run DELETE operations using the syntax above?
I understand that Qlik Replicate provides internal parameters to customize the SQL syntax it generates, such as $info.query_syntax.create_table for table creation. Is there an equivalent parameter for DELETE operations? If so, how could we set it so that the task uses the syntax shown above? If no such parameter exists, is there an alternative way to achieve the same result?
Thank you in advance for your support.
Best regards
I have a pivot table with a row dimension of City and column dimension of Category. My expression below only shows the correct values in the pivot table once i select a valye from the row dimension City. How can i get the pivot table to display the correct values without have to click a row dimension value?
Count( {< [Event Type] = {'MORTALITY'} , [Event Review Form Status]={'Completed'}>} [Category])
/
count( {< [Event Type] = {'MORTALITY'} , [Event Review Form Status]={'Completed'}>} Total [Event Review RN])
Hi,
For Talend Data Management Platform, if we need to implement a backup strategy for the main components such as Talend Administration Center (TAC), the database, and the JobServers, if they are installed in windows, what files, directories, configuration files, and application data should be backed up to ensure that the platform can be fully restored and brought back online in the event of a disaster or server failure?
thanks.
Hi Qlikkers,
Just a simple question, the QPI utility do an upgrade of a PostgreSQL version 9.x or 12.x to 14. Are there any plans to to do this upgrade to version 15 or 16 of PostgreSQL?
Kind regards
Gabriel
Hi everyone,
I am facing a critical security concern regarding Section Access and Binary Loads, and I would like to know if there is a way to prevent it.
The Scenario: I have a base application with Section Access properly applied to restrict data visibility. Another developer user consumes this app's data model using a Binary Load.
The Problem: The issue happens when this developer uses the STORE statement in their script to export the loaded tables into QVD or TXT files. The exported files are created without any access restrictions. The Section Access rules are completely bypassed in the stored data.
The Security Concern: Because of this behavior, a developer can easily extract restricted data into unrestricted files. I consider this a severe security risk and data leakage problem, and I am very concerned about the platform's data governance in this scenario.
My Questions:
Is there any way to block, disable, or restrict the use of the STORE command for developers who are using a Binary Load?
Are there any configurations, security rules, or best practices at the QMC/Tenant level to prevent this specific type of data extraction?
I understand that we could segregate access using Spaces. However, these developers need to access the data spaces to perform the Binary Load and consume the data model. Even if we restrict their write access to corporate Shared/Data Spaces, they might still be able to STORE the data into their Personal Spaces. How do you handle this architectural dilemma without completely stopping the use of Binary Loads?
Any insights or workarounds to secure this architecture would be greatly appreciated.
Thanks in advance!
Hi Team,
we are planning for LV automation in Qsense, need a Qsense APIs to hit QMC to get the info of stream, owner, name, created date. And to download dashboard as pdf.
Please help to provide the relevant APIs to do the above activities.
We're challenging our Qlik Community: put agentic AI to work.
We saw lots of great posts in our recent Make Your Data Work for AI forum. We’re building on that momentum with a new board focused on the next step: driving real impact with agentic AI.
This is the place to get started with agentic capabilities, try them out, and share your experience with the rest of the Community.
Here's the challenge:
Ask questions, share screenshots (obscuring any sensitive data), get ideas, and help your Qlik Community peers on their journeys.
You'll earn NEW Community badges along the way: Agentic AI Adopter when you share your first workflow or use case, and Agentic AI Expert when you share your learnings and results.
Plus, we’ll be awarding some fun surprises and new Qlik swag along the way!
Hello , I have a Button object in Qlik Sense . I want to display a tooltip text when hovering the mouse over the button (for example : display "Mobile" when hovering the Mobile button).
Qlik is a Leader in the IDC Events/Global Events MarketScape: Worldwide Data Intelligence Platform Software 2026 Vendor Assessment
Here’s your agentic AI readiness check. (Got Qlik? You're closer than you think.)
Set your course for six weeks of expert-led sessions on data, analytics, and AI — available on demand.
Built for the builders: Modern data engineering is AI powered — and engineer led.
The pilot-to-production gap is real. From fragmented data to governance gaps Qlik and AWS break down what’s holding your enterprise AI back — and how to solve them.
Your journey awaits! Join us by Logging in and let the adventure begin.