Logging multiple log console outputs to a csv file

[synfield]

Hi,
  I'm unsure about what the best approach would be to collect log console output data to a csv file.

At the moment I'm dumping all of the console output to a file and the resulting txt is, which I want as a csv with headers

tJava_1 code is :

java.io.File logFile = new java.io.File("_logs/"+projectName+".log");
java.io.PrintStream ps = new java.io.PrintStream(new java.io.BufferedOutputStream(new java.io.FileOutputStream(logFile)));

System.setOut(ps);
System.setErr(ps);

How can I get this into a csv?

Header > status code (200 or 400) | person_id |          contact_id           |      Full Name      | Error Message (if applicable)
Data >           200                        150014236      001O000000lJwuEIAS         Jono Bridges
                    400                                             00128000003KXkJAAW        Acme              A surname is required



P.S. - The tFileOutputDelimited components just appended each console output in the first column and wasn't as good as the tjava txt file which at least grouped the data together.
 

[Anonymous]

At the beginning of job, write the header information to the csv file first. eg:
tFixedFlowInput--main--tFileOutputDelimted
   |
other job parts.
on tFixedFlowInput, define the header columns. 
on other job parts, catch the error message and customize them, append them to the csv file.

[synfield]

Hi Shong,
Thanks for your reply.
I've defined the header via tFixedFlowInput --- main ---> tFileOutputDelimited at beginning of job, and it creates a csv with the headers i've defined.
However I'm not understanding how I insert the data under their respective header fields from log console at different points in the flow.
Can you please explain this in more detail. thanks.