topic Re: replace string on whole input line in Talend Studio

replace string on whole input line

Anonymous — Sat, 16 Nov 2024 13:47:03 GMT

Hi,
I'd like to replace strings on the whole input line in one step. Is this possible?
My file has >100 columns so I guess it was a performance drawback to replace them column by column.
Thanks
Guenter

Re: replace string on whole input line

Anonymous — Tue, 08 Sep 2009 07:10:06 GMT

Hello
Can you give us an example to expain your problem?
Does the tFileInputFullRow fit your need? It read the whole line as a column.
Best regards

shong

Re: replace string on whole input line

Anonymous — Wed, 09 Sep 2009 09:25:20 GMT

Example:
Input row structure:
Text1;Float1;Text2;Text3;.Float2;Float3;Int1;Time1;...;Text130;...Textn
The input consists of hundreds of columns. Since the text fields can contain unwanted characters like | & @ \n I need to replace them by other characters.
After replacement I have to process the rows column by column.
So my request is to do the replacement on the complete input row in one step regardless of the structure.
tFileInputFullRow provides the whole row as one string but:
1. input rows may contain \n (enclosed by " according to rfc4180)
2. how can I map the complete row(=1 string) to the columns needed for further processing?
Other ideas:
1) Is it possible to read the file line by line, do the replacement, write the lines to an in-memory-file and open the in-memory-file with the tFileInputDelimited component?
2)
- use sed in a tSystem-component for replacement
- read the sed-output via a pipe
Is this possible?
Thanks
Guenter

Re: replace string on whole input line

_AnonymousUser — Thu, 29 Sep 2011 19:19:44 GMT

I have exactly this problem (as per the most recent message which doesn't look like it was ever answered) - any idea what the best solution is?
Thanks very much

Re: replace string on whole input line

Anonymous — Thu, 27 Sep 2012 14:44:53 GMT

Same problem here. Any hints?

Re: replace string on whole input line

janhess — Thu, 27 Sep 2012 15:36:42 GMT

Read each row as a single data item and do the replace on that.

Re: replace string on whole input line

alevy — Fri, 28 Sep 2012 08:38:10 GMT

tFileInputFullRow --> tReplace --> tExtractDelimitedFields -->
or
tFileInputDelimited --> tJavaRow --> using reflection to cycle through the fields and do your replace (see https://community.talend.com/t5/Design-and-Development/resolved-Automatically-trim-non-String-fields/td-p/86607)