topic Identify and mark duplicate records in load script in App Development

Identify and mark duplicate records in load script

jagjivvt — Tue, 30 Nov 2021 16:25:32 GMT

I need to mark each duplicate record in load script with an incremental number.

InvoiceID, Mark

1 , 1

1, 2

2,1

2,2

3,1

and so on.

thanks

LReeve — Wed, 17 Nov 2021 09:31:53 GMT

Hi Jagjvvt,

Try something like this:

tmpTable:

Load InvoiceID,

1 As Mark

From File;

NoConcatenate

FinalTable:

Load

InvoiceID,

If(InvoiceID = Previous(InvoiceID), Peek('Mark') + 1, Mark) As Mark

Resident Table

Order By InvoiceID;

You may need to also sort by a datetime value to mark the invoices correctly.

jagjivvt — Wed, 17 Nov 2021 11:28:23 GMT

Thank you