topic Re: Pipeline Delimiter between data. in Talend Studio

Pipeline Delimiter between data.

Sasidhar1 — Sat, 16 Nov 2024 03:07:19 GMT

My data is having pipeline between data with double quotes.

and delimiter is also pipeline.

I am trying of using only tFileInputDelimiter > tFileOutputDelimiter INPUT- containing Pipeline between dataOUTPUT- last field is missing for the same row.In output the last field is missing for the row containing pipeline between data.

I tried CSV options (escape char & Text Enclosure) in many ways in both the components but i failed.

Requirement -

1) I want the output to be "same" as in input (Don't want output with all the fields having double quotes or in any other way). and if possible the pipeline between the data having double quotes should be removed. All fileds having Double Quotes- Got some solutions here for getting this kind of output. but I dont want double quotes for all.

2) Is that possible to do by using only tFileInputDelimiter and tFileOutputDelimiter ?

3) Better if no other component is used.

so,can anyone please help me with this...

Re: Pipeline Delimiter between data.

Sasidhar1 — Tue, 03 Mar 2020 07:11:54 GMT

tMap can be used in between those to components

Re: Pipeline Delimiter between data.

Anonymous — Tue, 03 Mar 2020 07:37:53 GMT

Hi Sasidhar,

I tried by taking 2 sample rows from your input.

I got output like below. There is no lose of column

Settings used in tfileInputDelimited:

Settings in tfileoutputdelimited (Advanced settings)

Please check if this answer is helpful to you.

Thanks.

Re: Pipeline Delimiter between data.

Sasidhar1 — Tue, 03 Mar 2020 07:56:39 GMT

hi vinod, thank you.

actually Im also getting the same output as you.

but i dont want double quotes for all the other fields.

1) output should be same as input

2) "if possible" pipeline between the data having double quotes should be removed.

Re: Pipeline Delimiter between data.

Anonymous — Tue, 03 Mar 2020 08:54:22 GMT

Hi Sasidhar,

By using tMap, we can achieve output as same as input.

Use below expression for column 2.

"\""+row3.col2+"\""

I got same output as input.

Note : Uncheck the "CSV option" in advance settings for tfileoutputDelimited.

Thanks.

Re: Pipeline Delimiter between data.

Sasidhar1 — Tue, 03 Mar 2020 09:51:16 GMT

hi vinod, thank you for your solution.

it worked.