Qlik Community

New to Qlik Sense

Discussion board where members can get started with Qlik Sense.

dpponugoti
New Contributor II

QlikSense data load not fetching new/ updated data

I am trying to load data from databricks tables that get updated daily. But data load editor in QlikSense is not fetching any new data. It is only giving the same number of lines every time I load data.

The number of lines fetched increased when I changed connector but again remained constant for that particular connector. Can someone help me with this?

1 Solution

Accepted Solutions
MVP
MVP

Re: QlikSense data load not fetching new/ updated data

I think you might be a victim of either caching on the Databricks Spark side or that the updates will demand that an active "update" is performed from the query side to be able to view the updated data since they most probably are residing in new files on the Databricks or Databricks source side....

Have a look here: Databases and Tables — Databricks Documentation

5 Replies
MVP
MVP

Re: QlikSense data load not fetching new/ updated data

What kind of connector are you using in your load editor?

MVP
MVP

Re: QlikSense data load not fetching new/ updated data

I think you might be a victim of either caching on the Databricks Spark side or that the updates will demand that an active "update" is performed from the query side to be able to view the updated data since they most probably are residing in new files on the Databricks or Databricks source side....

Have a look here: Databases and Tables — Databricks Documentation

dpponugoti
New Contributor II

Re: QlikSense data load not fetching new/ updated data

I'm using ODBC Apache Spark connector

dpponugoti
New Contributor II

Re: QlikSense data load not fetching new/ updated data

Thank you. I just added REFRESH TABLE line while loading data and it worked.

MVP
MVP

Re: QlikSense data load not fetching new/ updated data

You're welcome

Please mark the question as answered by tagging the correct answer as correct.

Community Browser