topic insert, update and delete incremental load problem sos in App Development

insert, update and delete incremental load problem sos

ioannagr — Wed, 17 Mar 2021 14:26:10 GMT

Hello all, i also posted this also on "New to Qlik Sense" forum, but also on here because I believe this board is also appropriate.

I'm doing an incremental load with the date field coming from another table to keep the records, so i have:

[Table]:

LOAD id as [Row ID],
problem_id ,
person_id ;

SQL SELECT a.id,
a.problem_id,
a.person_id, b. b.updated
FROM "public."source_table1" a
inner join "public"."source_Table2" b
on a.person_id=b.id
where b.updated >'$(Last_Update)';

JOIN([Table])

LOAD id as problem_id,
description as problem_description;

SQL SELECT "id",
"description"
FROM "public"."source_table3";

Concatenate
Load * from [$(vPathQVD)Table.qvd] (qvd)
WHERE NOT EXISTS([Row ID]);

Inner Join SQL SELECT id from "public."source_table1";

-----

BUT my final qvd, ends up with an extra id column...also i believe id and "Row ID" should be one column... but they are not and are filled not with same numbers.

could REALLY use your help.

Thanks in advance.

Re: insert, update and delete incremental load problem sos

Or — Wed, 17 Mar 2021 14:50:50 GMT

Why would id and Row ID be the same column? You've clearly left them as two different columns..?

Row ID comes from the first load and also the third. id is only visible in the last query (which has no associated load) and is supposed to join to something, so I am assuming 'id' is also a field in the Load * which we can't see and this is intended to filter out any id values which are not found in $(vPathQVD)Table.qvd

Re: insert, update and delete incremental load problem sos

ioannagr — Wed, 17 Mar 2021 15:03:45 GMT

Well, i care to keep the new RowIDs and delete the old ones, according to Last_Update, So that's why i do where not exists RowID for the initial QVD and i want to inner join with the primary id from source table but that's where i seem to lose it......

maybe i should consider this "

SQL SELECT a.id,
a.problem_id,
a.person_id, b. b.updated
FROM "public."source_table1" a
inner join "public"."source_Table2" b
on a.person_id=b.id"

as the source table?

What is this you suggest @Or ?