topic Re: Reading dyamic Multi comma delimeter files(multiple delmeter in source File) in Talend Studio

Reading dyamic Multi comma delimeter files(multiple delmeter in source File)

Anonymous — Mon, 21 Jan 2019 08:39:42 GMT

Hi Team I have below file structure ,

Name , Id , OrderNumber

Joo ,11,Afb000G

Jasmi,13,Afb,000,G

Josh, 16,Afb,000G

in the above example comma is coming as row separated also in the metadata --I m mot able read this kind of file , can anyone help me how to fix this issue in Talend open source .

thanks

Re: Reading dyamic Multi comma delimeter files(multiple delmeter in source File)

Anonymous — Mon, 21 Jan 2019 10:43:45 GMT

hello @Moe ,

step 1:- import your source file as file delimated and field seperator as comma seprate

step 2 :- In designer window connect source with tmap and concate(+) and map it to one output file

see below attached screenshot

Thanks,

Re: Reading dyamic Multi comma delimeter files(multiple delmeter in source File)

akumar2301 — Mon, 21 Jan 2019 10:45:46 GMT

Also Can you try to put last Column OrderNumber as Dynamic instead of String.

I have not tested but it could work. Let me know.

Re: Reading dyamic Multi comma delimeter files(multiple delmeter in source File)

Anonymous — Mon, 21 Jan 2019 10:46:24 GMT

Hi,

There are multiple ways you can handle this issue. The best and easy way is to ask the source team to send the data in text enclosure format so that you can easily decide that the data inside double quotes are indeed part of same column. If extra comma is present, then you can remove them by replace function of java (lot of Talend community posts are having solutions to replace characters).

Another difficult way is to do pattern processing where you need to pick the full row and parse them to multiple columns based on patterns of your data. This is a cumbersome process and there may be still chances that you may get error.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂