topic Re: Put Multiple Columns in one Column on a array in Talend Studio

Put Multiple Columns in one Column on a array

_AnonymousUser — Sat, 16 Nov 2024 14:19:25 GMT

Hi to all !
i'm reading a txt file, filtering every row by an ID in other files, and unite with a tMap in the end all the rows(i set the delimiter "|" when i use in my file this delimiter ";" and then Talend take the row and put in one columns) this because i want to change the delimiter and because every row have a different schema!!
Statistics : 7 txt File(240kb) in 4minutes...and i'm using 19 temporary file for the elaboration!!!
Actually i'm using to much temporary files and my Jobs are going slow, how can i put Multiple Columns in One Column without doing this long and slow way?

Re: Put Multiple Columns in one Column on a array

Anonymous — Thu, 26 Jun 2008 08:15:12 GMT

Hello
There is a related 2017.
Do you have the same situation?
if not, can you show some input example?
Best regards
shong

Re: Put Multiple Columns in one Column on a array

_AnonymousUser — Thu, 26 Jun 2008 13:55:39 GMT

Hi Shong, thank you for the response!
I saw the other cases but it doesn't seem to be the same thing!!
My situation is in this way :
1.I have my file in input with delimiter "," , i just want to change that with ";" and to delete the "
2.On inside the file i have many kind of rows, with different schemas :
"00","Column1","Column2","Column3","Column4"
"01","Column1","Column2","Column3","Column4",Column5","Column6"
"02","Column1","Column2","Column3"
In output i want this :
00;Column1;Column2;Column3;Column4
01;Column1;Column2;Column3;Column4;Column5;Column6
02;Column1;Column2;Column3;Column4;Column5;Column6;Column7;Column8
03;Column1;Column2;Column3;Column4;Column5
04;Column1;Column2
I've made this job filtering every single row in a different file and then i unite them with a tMap because every row have different schemas
http://picasaweb.google.com/gjergjD/TOS/photo#5216169101775334994
http://picasaweb.google.com/gjergjD/TOS/photo#5216170812215440946
http://picasaweb.google.com/gjergjD/TOS/photo#5216170098873479618
My question was if exist a way without using many temporary file for do this job?
Thank you
Ps: sorry for the links
Best Regards,
JamesB

Re: Put Multiple Columns in one Column on a array

Anonymous — Thu, 26 Jun 2008 16:51:02 GMT

Hello,
Put "\r\n" for "row separator" in your tFileOutputDelimited

Re: Put Multiple Columns in one Column on a array

_AnonymousUser — Thu, 26 Jun 2008 17:18:38 GMT

Hi Stephane, thank y for the response!
Sorry but I don't know if y understand what i need. My job it works, but the gap is that is slow because i use to much temporary files.
I would like to find another way to do this without this temporary files(maybe with using arrays).
I didn't understand the reason for using (\r\n), actually i'm using(\n).
Best Regards,
JamesB

Re: Put Multiple Columns in one Column on a array

Anonymous — Fri, 27 Jun 2008 03:48:15 GMT

Hello JamesB

I would like to find another way to do this without this temporary files(maybe with using arrays).

Here is a job shows how to use an array in a job, see 2288.
Best regards
shong

Re: Put Multiple Columns in one Column on a array

Anonymous — Fri, 27 Jun 2008 13:02:34 GMT

Hello JamesB,
Oups, i don't understand what you need
My english is not very good.... sorry i'm french 😉
good luck

Re: Put Multiple Columns in one Column on a array

_AnonymousUser — Mon, 30 Jun 2008 16:55:12 GMT

Thanks to both !!
I'll try with the example of the array in the topic 2288
Best Regards,
JamesB

Re: Put Multiple Columns in one Column on a array

_AnonymousUser — Wed, 02 Jul 2008 11:12:00 GMT

Hi SHONG !
i want to update to all about this post:
i said that my elaboration with talend was to slowly!!!
I was wrong about that, sorry!
my elaboration is a bit complicated, it was not the temporary file that make slow my job, but the relation in the father job, for example i was mapping with an iterate a tFIleInputDelimited with a tRunJob, it happening that the job elaborates the same file to many times before to continue with the second, the third file...so now i adjusted this thing and my job goes really fast.
thank you very much for the support
JAmesB
PS: never doubted that talend is a spectacular Software