Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Welcome to
Qlik Community!

cancel
Showing results for 
Search instead for 
Did you mean: 
  • 280,333 members
  • 11,639 online
  • 2,052,205 posts
  • 155,150 Solutions
Announcements
Share your agentic AI experience, learn from others, and earn a new badge: Put Agentic AI to Work

Welcome to Qlik Community

Recent Discussions

  • forum

    Qlik Replicate

    Custom DELETE syntax to fix a stuck operation on a large table in Databricks

    Hello,I’ve configured a Log Stream task to read from a Microsoft Azure SQL database, along with a replication task that reads from this Log Stream and... Show More

    Hello,

    I’ve configured a Log Stream task to read from a Microsoft Azure SQL database, along with a replication task that reads from this Log Stream and replicates data to a Databricks Lakehouse (Delta) endpoint.

    Among the replicated tables, there is one with about 380 million records and 18 columns, which accumulates between 200,000 and 400,000 changes during the full load, which typically takes several hours.

    Over the past few weeks, once the full load of this table completes, the task has been unable to apply the changes to Databricks. Specifically, the task tries to apply the DELETE operations on the table and remains in running state for tens of hours without completing the operation successfully.

    The DELETE operation has this form:

    DELETE FROM my_database.target_table T
    WHERE EXISTS (
        SELECT C.seg1
        FROM my_database.attrep_changes_table C
        WHERE (
            T.primary_key = CAST(C.seg1 AS INT)
            OR (T.primary_key IS NULL AND C.seg1 IS NULL)
        )
        AND C.seq >= 1
        AND C.seq <= 200100
    );

    We have tried several alternatives to solve the problem, including:

    • reducing the change batch size;
    • increasing the query timeout of the operations;
    • optimizing the large table to make delete operations more efficient;
    • replicating only the last 6 months of data for the large table.

    Unfortunately, none of these attempts was successful.

    However, we verified that the following DELETE operation runs in 30 seconds on Databricks:

    DELETE FROM my_database.target_table
    WHERE primary_key IN (
        SELECT CAST(seg1 AS INT)
        FROM my_database.attrep_changes_table
        WHERE seq BETWEEN 1 AND 200100
          AND seg1 IS NOT NULL
    );

    Is it possible to configure the replication task to run DELETE operations using the syntax above?

    I understand that Qlik Replicate provides internal parameters to customize the SQL syntax it generates, such as $info.query_syntax.create_table for table creation. Is there an equivalent parameter for DELETE operations? If so, how could we set it so that the task uses the syntax shown above? If no such parameter exists, is there an alternative way to achieve the same result?

    Thank you in advance for your support.

    Best regards

    Show Less
  • forum

    App Development

    pivot table chart ONLY shows correct values once the ROW dimension is selected

    I have a pivot table with a row dimension of City and column dimension of Category.  My expression below only shows the correct values in the pivot ta... Show More

    I have a pivot table with a row dimension of City and column dimension of Category.  My expression below only shows the correct values in the pivot table once i select a valye from the row dimension City.  How can i get the pivot table to display the correct values without have to click a row dimension value?

     

    Count( {< [Event Type] = {'MORTALITY'} , [Event Review Form Status]={'Completed'}>} [Category])

    /

    count( {< [Event Type] = {'MORTALITY'} , [Event Review Form Status]={'Completed'}>} Total [Event Review RN])

    Show Less
  • forum

    Administering and Monitoring

    Talend Data Managment Platform Backup Strategy

    Hi,For Talend Data Management Platform, if we need to implement a backup strategy for the main components such as Talend Administration Center (TAC), ... Show More

    Hi,

    For Talend Data Management Platform, if we need to implement a backup strategy for the main components such as Talend Administration Center (TAC), the database, and the JobServers, if they are installed in windows, what files, directories, configuration files, and application data should be backed up to ensure that the platform can be fully restored and brought back online in the event of a disaster or server failure?

     

    thanks.

    Show Less
  • forum

    Management & Governance

    Working with QPI and new versions of PostgreSQL

    Hi Qlikkers,Just a simple question, the QPI utility do an upgrade of a PostgreSQL version 9.x or 12.x to 14. Are there any plans to to do this upgrade... Show More

    Hi Qlikkers,

    Just a simple question, the QPI utility do an upgrade of a PostgreSQL version 9.x or 12.x to 14. Are there any plans to to do this upgrade to version 15 or 16 of PostgreSQL?

    Kind regards

    Gabriel

    Show Less
  • forum

    App Development

    How to block the STORE statement for users using Binary Load?(QLIK CLOUD)

    Hi everyone, I am facing a critical security concern regarding Section Access and Binary Loads, and I would like to know if there is a way to prevent ... Show More

    Hi everyone,

    I am facing a critical security concern regarding Section Access and Binary Loads, and I would like to know if there is a way to prevent it.

    The Scenario: I have a base application with Section Access properly applied to restrict data visibility. Another developer user consumes this app's data model using a Binary Load.

    The Problem: The issue happens when this developer uses the STORE statement in their script to export the loaded tables into QVD or TXT files. The exported files are created without any access restrictions. The Section Access rules are completely bypassed in the stored data.

    The Security Concern: Because of this behavior, a developer can easily extract restricted data into unrestricted files. I consider this a severe security risk and data leakage problem, and I am very concerned about the platform's data governance in this scenario.

    My Questions:

    1. Is there any way to block, disable, or restrict the use of the STORE command for developers who are using a Binary Load?

    2. Are there any configurations, security rules, or best practices at the QMC/Tenant level to prevent this specific type of data extraction?

    I understand that we could segregate access using Spaces. However, these developers need to access the data spaces to perform the Binary Load and consume the data model. Even if we restrict their write access to corporate Shared/Data Spaces, they might still be able to STORE the data into their Personal Spaces. How do you handle this architectural dilemma without completely stopping the use of Binary Loads?

    Any insights or workarounds to secure this architecture would be greatly appreciated.

    Thanks in advance!

    Show Less
  • forum

    Catalog and Lineage

    Requesting for APIs

    Hi Team,we are planning for LV automation in Qsense, need a Qsense APIs to hit QMC to get the info of stream, owner, name, created date. And to downlo... Show More

    Hi Team,
    we are planning for LV automation in Qsense, need a Qsense APIs to hit QMC to get the info of stream, owner, name, created date. And to download dashboard as pdf.
    Please help to provide the relevant APIs to do the above activities.

    Show Less
  • forum

    Put Agentic AI to Work

    Qlik Community Challenge: Put Agentic AI to Work

    We're challenging our Qlik Community: put agentic AI to work.  We saw lots of great posts in our recent Make Your Data Work for AI forum. We’re buildi... Show More

    We're challenging our Qlik Community: put agentic AI to work. 

    We saw lots of great posts in our recent Make Your Data Work for AI forum. We’re building on that momentum with a new board focused on the next step: driving real impact with agentic AI.

    This is the place to get started with agentic capabilities, try them out, and share your experience with the rest of the Community.

    Here's the challenge:

    1. Get started. Toggle on Qlik Answers, activate Qlik’s MCP Server, or get started with whichever capability fits your work, and see how easy it really is.
    2. Build your first workflow. Identify a use case and put the capabilities to work on a real problem or task.
    3. Share your experience. Tell the Community what you learned, what worked, and what surprised you.

    Ask questions, share screenshots (obscuring any sensitive data), get ideas, and help your Qlik Community peers on their journeys.

    You'll earn NEW Community badges along the way: Agentic AI Adopter when you share your first workflow or use case, and Agentic AI Expert when you share your learnings and results.

    Badges-Community-Agentic-adopter (1).pngBadges-Community-Agentic-Expert (2).png

     

     

     

     

     

     

    Plus, we’ll be awarding some fun surprises and new Qlik swag along the way!  

     

    Show Less
  • forum

    Qlik Automate

    Build Auto Disabling Workflow for Incactive users

    Hi Team, I need to prepare the workflow that disables inactive users automatically.I are able to get last login details from the Qlik Entitlement Anal... Show More
    Hi Team,
     
    I need to prepare the workflow that disables inactive users automatically.
    I are able to get last login details from the Qlik Entitlement Analyzer app and also have an API to update users from the Qlik API doc,
     
    I need to understand how we can make requests from Qlik Automation via the Call Raw API block, and feel free to suggest any other better approach.
     
     
    Show Less
  • forum

    Visualization and Usability

    Tooltip on a Button

    Hello , I have a Button object in Qlik Sense . I want to display a tooltip text when hovering the mouse over the button (for example : display "Mobile... Show More

    Hello , I have a Button object in Qlik Sense . I want to display a tooltip text when hovering the mouse over the button (for example : display "Mobile" when hovering the Mobile button).

    Show Less
  • forum

    Connectivity & Data Prep

    "Error: Unable to connect for result set" - Sharepoint data connection

     Hello community,  we use several SharePoint data connections in Qlik Sense On-Prem to load data from SharePoint into a Qlik app. We occasionally enco... Show More
     
    Hello community,
     
    we use several SharePoint data connections in Qlik Sense On-Prem to load data from SharePoint into a Qlik app. We occasionally encounter reload tasks that fail with the error message: "Error: Unable to connect for result set." Usually, simply restarting the reload tasks allows them to complete successfully, though sometimes they fail again with the same error. Is anyone familiar with this error and does anyone know what it indicates or how to resolve it?
     
    Kind regards,
    Vanessa
    Show Less
Leaderboard

Qlik community MVPs

Qlik Community MVPs — trusted experts driving collaboration, learning, and innovation.

mvp-banner-side-image