topic Re: Dynamically drop fields from input to output in Talend Studio

Dynamically drop fields from input to output

ankushd — Thu, 11 Apr 2019 07:55:43 GMT

Hello All,

Please see below use case and let me know how we can implement?

INPUT

COL1 | COL2| COL3| COL4

I Want to drop anyone of the column at run time(accepting either through Context Or prompt) and pass other columns.

Lets say i decide to drop COL4 , then output should be

COL1|COL2|COL3

Re: Dynamically drop fields from input to output

David_Beaty — Thu, 11 Apr 2019 09:03:56 GMT

Hi,

You'll probably need to read the rows in with the full row component and manually split it apart and reconstruct it back into a single column and write out. It won't be pretty, but it will work.

Re: Dynamically drop fields from input to output

akumar2301 — Thu, 11 Apr 2019 15:51:42 GMT

Yes there is no component to do so . Other way is to use Regex Pattern to remove a column value.

Step 1) Find index of column needs to be removed

Step2) using below java pattern , remove column index found in step1 ( assuming input is comma separated)

"^((\\w,){nth})(?:\\w,)(.*)$"

Attaching a sample job for you which could help.

dsfhfdgk_0.1.zip
in.csv