QlikSense data load not fetching new/ updated data

[Anonymous]

I am trying to load data from databricks tables that get updated daily. But data load editor in QlikSense is not fetching any new data. It is only giving the same number of lines every time I load data.

The number of lines fetched increased when I changed connector but again remained constant for that particular connector. Can someone help me with this?

[petter]

What kind of connector are you using in your load editor?

[petter · Accepted solution]

I think you might be a victim of either caching on the Databricks Spark side or that the updates will demand that an active "update" is performed from the query side to be able to view the updated data since they most probably are residing in new files on the Databricks or Databricks source side....

Have a look here: Databases and Tables — Databricks Documentation

[Anonymous]

I'm using ODBC Apache Spark connector

[Anonymous]

Thank you. I just added REFRESH TABLE line while loading data and it worked.

[petter]

You're welcome

Please mark the question as answered by tagging the correct answer as correct.