topic Re: Talend field by field comparison in Talend Studio

Talend field by field comparison

Anonymous — Mon, 08 Apr 2019 03:57:47 GMT

Hi ,

I am creating a solution to compare field by field source and target tables.

I have two input stages tDBinput (one for source table and one for target table )both with ID as first column and second column as dynamic (so that same job can be used for other tables for comparison.)

Now I need to compare all columns including ID and rest all in dynamic column. Also need to call out any fallout if any of the field is not getting matched between source and target tables.

can anyone please suggest which components I will need to use to achieve this?

Re: Talend field by field comparison

manodwhb — Mon, 08 Apr 2019 05:18:35 GMT

@usermigration ,i suggest you to use tAddCRCRow component to generate unique key for all the column in source and target and you do lookup in tmap or tjoin on the key which is generated in tAddCRCRow .

Re: Talend field by field comparison

Anonymous — Mon, 08 Apr 2019 20:48:38 GMT

@manodwhb I am getting error as tAddCRCRow component doesn't support dynamic type.

I have two columns first is ID and second is dynamic column , I selected dynamic column in tAddCRCRow.

Re: Talend field by field comparison

manodwhb — Tue, 09 Apr 2019 05:11:12 GMT

@usermigration , tAddCRCRow works with static schema.

Re: Talend field by field comparison

Anonymous — Tue, 09 Apr 2019 07:20:00 GMT

@manodwhb

Thanks, So with Dynamic schema are there any operation that we can do? or are there any component which support dynamic schema processing from validation or comparison perspective?

I tried tMap and matched on dynamic column for both main and lookup but no luck .

Re: Talend field by field comparison

manodwhb — Tue, 09 Apr 2019 07:25:06 GMT

@usermigration ,with dynamic schema , we do not have any component to do,but as a try you can try with some java code.

but relay not sure how to do in java code

Re: Talend field by field comparison

Anonymous — Tue, 09 Apr 2019 07:41:37 GMT

@manodwhb got it, so if I switch to static schema, then from validation (field by field) perspective, which components will you recommend ?

Re: Talend field by field comparison

manodwhb — Tue, 09 Apr 2019 07:44:13 GMT

@usermigration ,if it is static schema,you can do with tAddCRCRow to generate unique CRC and then do lookup in tMap and form there you derive the things.