Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I am running a Job on which I have put some auto-fix condition o a column. I am getting the correct result, but in the output table can we have only those records on which the 'fix' was applied? Currently it is showing all the records. Because we may have thousands of records, so showing only those records where fix was applied would be very useful.
Can you explain clearly with example what is the source and Target data ?
Like as you see in my screenshot above, I had to define a new column to let the users see the old column value and new transformed value after the 'rule' applied. Instead is it possible to show in the output like one row as 'old record' and next row as 'new-modified record' fro comparison purposes. The schema is same for both 'source and 'target table' as it would be a temporary staging table.
@ppp_rrr wrote:
[...] Instead is it possible to show in the output like one row as 'old record' and next row as 'new-modified record' fro comparison purposes. [...]
Hi ppp_rrr,
my suggestion for this set-up is to use two outputs as shown in the image.
two outputs fixed and original value
Direct the Outputs for example to HashOutputs or (temporary) files. Use HashInput or file input components to read the data and a tUnite component to combine these two inputs into one. (If you use two linked HashOutput components you can use just one HashInput for reading.) Then let the data flow to a tSortRow component, sorting first on "sequence_number", then on "flag_fixed" (asc or desc, depending on whether you want the fixed row first or the original row).
Please note that the sequence is generated in the "Var" panel, so that for one input row both outputs get the same sequence_number.
Best regards,
Thomas