topic Re: spliting files an renaming files in Talend Studio

spliting files an renaming files

Anonymous — Sat, 16 Nov 2024 13:16:12 GMT

Hi,
I'm new on Talend.
I'm trying to create a file for each row I have in my database and want to rename each file whith a unique variable I have in the row.
My input file is a mysql database, I use a tmap before spliting in multiples files using xmloutput composant.
I try to put a variable in the "+("row1.id")+".xml", I have a null1, null2, null3 ....
Thanks for help
Sorry for my english

Re: spliting files an renaming files

Anonymous — Thu, 30 Sep 2010 21:07:31 GMT

Hello,
I still need help
Thanks

Re: spliting files an renaming files

Anonymous — Fri, 01 Oct 2010 03:50:52 GMT

Hello
tMysqlInput---row1-->tFlowToIterate---iterate-->tAdvancedOutputXML
on tFlowToIterate, generate each row.
set the file as:
"..."+row1.id+".xml"
If you still have any trouble, please give us an example of your request.
Best regards
Shong

Re: spliting files an renaming files

Anonymous — Fri, 01 Oct 2010 09:41:56 GMT

hello
Thanks for your help.
I can't see how I can change my job with your solution
Here is my flow

Re: spliting files an renaming files

Anonymous — Thu, 07 Oct 2010 10:42:50 GMT

hello,
I still need help
I'm not the only one with this issue
https://community.talend.com/t5/Design-and-Development/Generate-an-XML-file-per-row-Root-and-row-tag-problems/td-p/72628
Thanks

Re: spliting files an renaming files

Anonymous — Thu, 07 Oct 2010 15:47:55 GMT

I see your issue. you cannot connect an iterate link to a tFileOutputXML. To make this work, use a tJavaFlex to read from the iterate link one row at a time.

dbInput --> tMap --> tFlowToIterate --> tJavaFlex --> tFileOutputXML
in your tJavaFlex, propogate the data with this code in the MAIN section:

BEGIN SECTION: 
<empty>
MAIN SECTION: 
row2.newColumn = globalMap.get("row1.newColumn").toString();
END SECTION:
<empty>

in my example row2 is the output row of the tJavaFlex and row1 is the input row to my tFlowToIterate. you will need to replace that with what your output/input rows are.
in the tFileOutputXML use this code in the File Name field:

/file_example/file_header_" + globalMap.get("row1.newColumn").toString() + ".xml"

Re: spliting files an renaming files

Anonymous — Fri, 08 Oct 2010 10:06:24 GMT

hello,
thanks for your help !
I followed your solution, I made some screenshot.
I have an error on the tjavaflex, don't know why

Thanks
The error :
connecting to socket on port 3561
connected
Exception in component tJavaFlex_1
java.lang.NullPointerException
at webedition.test_0_1.test.tMysqlInput_2Process(test.java:8742)
at webedition.test_0_1.test.runJobInTOS(test.java:10732)
at webedition.test_0_1.test.main(test.java:10593)
disconnected
Job test terminé à 14:02 08/10/2010.

Re: spliting files an renaming files

Anonymous — Fri, 08 Oct 2010 14:32:30 GMT

It looks like you are referencing the wrong row varibles in the tJava flex. The input to your tFlowToIterate is row11, the output of the java flex is row10.
change your code from this:
row11.EAN = globalMap.get("row6.gdl_ean").toString();
to this:
row10.EAN = globalMap.get("row11.gdl_ean").toString();

Re: spliting files an renaming files

Anonymous — Fri, 08 Oct 2010 14:42:45 GMT

thanks but it doesn't work
I haven't go any row10 in my tmap. Is it normal ?
And row11 is before row 10 in the flow, is it a problem ?

Re: spliting files an renaming files

Anonymous — Fri, 08 Oct 2010 14:51:29 GMT

it dosnt matter what the input and output are called, just that they are referenced correctly. I've uploaded your screenshot with input and output highlighted.
<OUTPUT_ROW_VAR>.<OUTPUT_COLUMN_NAME> = globalMap.get("<INPUT_ROW_VAR>.<INPUT_COLUMN_NAME>").toString();

Re: spliting files an renaming files

Anonymous — Mon, 11 Oct 2010 14:27:33 GMT

Hello,
Thanks very much for your help !
It works now ! I have all my files with the right name but XML fields are now empty except for the EAN.
Do I have to set global var for each field ? Where ?

Re: spliting files an renaming files

Anonymous — Mon, 11 Oct 2010 16:05:54 GMT

I try to set all vars in the tjavaflex ! It works for row11
row10.SERIEL=globalMap.get("row11.SERIEL").toString(); WORK
row10.ISBN=globalMap.get("row11.ISBN").toString(); WORK
row10.EAN=globalMap.get("row11.EAN").toString(); WORK
row10.AGEDEB=globalMap.get("row9.cum_age").toString(); DOESN'T WORK
Any help please ?

Re: spliting files an renaming files

Anonymous — Tue, 12 Oct 2010 14:12:55 GMT

the tFlowToIterate is what is putting the row values into the global map. row9 is not being processed by the flowToIterate-- so its values will not be put into the global map.
looking at your screenshots, all you would need to do is include the "cum_age" column in your row11 output table in the tMap, then you will be able to pull it out of the global map like all the other row11 values.

Re: spliting files an renaming files

Anonymous — Tue, 12 Oct 2010 14:21:44 GMT

I put the row9.cum_age in row11.AGEDEB in the TMAP but when I do a row10.AGEDEB =globalMap.get("row11.AGEDEB ").toString(); in the tjava flex it doesn't work
error
Exception in component tJavaFlex_1
java.lang.NullPointerException
at webedition.test_0_1.test.tMysqlInput_2Process(test.java:3428)
at webedition.test_0_1.test.runJobInTOS(test.java:5371)
at webedition.test_0_1.test.main(test.java:5243)

Re: spliting files an renaming files

Anonymous — Tue, 12 Oct 2010 14:34:58 GMT

are you still refering to it with this?
row10.EAN=globalMap.get("row9.cum_age").toString();
if so, change it to:
row10.EAN=globalMap.get("row11.AGEDB").toString();

Re: spliting files an renaming files

Anonymous — Tue, 12 Oct 2010 14:38:18 GMT

I made an error sorry it's not
row10.EAN=globalMap.get("row9.cum_age").toString();
but
row10.AGEDB=globalMap.get("row9.cum_age").toString();
I tried both, they don't work.
row10.AGEDB=globalMap.get("row11.AGEDB").toString();
row10.AGEDB=globalMap.get("row9.cum_age").toString();

Re: spliting files an renaming files

Anonymous — Wed, 13 Oct 2010 09:49:27 GMT

Just a little help for this please !

Re: spliting files an renaming files

Anonymous — Wed, 13 Oct 2010 14:23:40 GMT

Can you post a few more screenshots of what you're working with? Please include the inside of the tMap and tJavaFlex.

Re: spliting files an renaming files

Anonymous — Wed, 13 Oct 2010 15:13:32 GMT

Now I manage to get the row11.ean name for filename and i can set globalvar for every row11 that came from the row6 but
it doesn't work for those which came from row8 or row9 so I can fill my xml file with all fields.
The line row10.AGEDEB=globalMap.get("row11.AGEDEB").toString(); in the tjavaflex doesn't work
Maybe I have to make a join in the tjavaflex but how ?

Here is the flow, the tmap and the tJavaFlex

Thanks

Re: spliting files an renaming files

Anonymous — Mon, 18 Oct 2010 09:14:38 GMT

Hello
I still can't make it work,
Thanks