topic Re: Exception Report Design in Qlik Sense in App Development

Exception Report Design in Qlik Sense

mthulisi — Sat, 16 Nov 2024 00:46:13 GMT

I am extracting data (just a couple of columns) using a REST API into Qlik Sense. The extract should be run every end of the month. I need to build an exceptions report that compares the previous extract to the new extract - it should show number of new rows, rows that were updated, etc. My source data has no timestamp.

I can achieve this manually by extracting the first dataset (at the beginning of the month) into excel and extracting the other one at the end of the month and then comparing the two. This is the process i want to automate on Qlik. I am looking for ideas on how i can implement this. Is there a way to persist a dataset after extracting it? How do i ensure the other extract is only run on the last day of the month? Any ideas would help.

Re: Exception Report Design in Qlik Sense

Ksrinivasan — Sun, 24 Jan 2021 14:05:00 GMT

hi,

while extract you can use this as preceding load, then automatically exact date and time will added into your data as new field,

Load *,

Timestamp(now(), 'YYYY/MM/DD hh:mm:ss TT') as DownTIMESTAMP;

ksrinivasan

Re: Exception Report Design in Qlik Sense

mthulisi — Fri, 29 Jan 2021 14:08:10 GMT

Good idea. How will I maintain the old (historic) dataset. Is there a way to do an incremental load (I think its possible in Qlik View with *.qvds). So that i do not overwrite my existing dataset

Re: Exception Report Design in Qlik Sense

Ksrinivasan — Fri, 29 Jan 2021 16:27:40 GMT

hi,

nice to hear,

if you have date stamp for old data, then you can use left join for adding in to old data.

as you mentioned use qvd. but old data table and date stamp table should have common key.

ksrinivasan