Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I have a job that reads a csv file, retrieves some values and stores them into global variables, then uploads a file to S3. When that it's done, I'd like to write the global variables and the outcome of S3 upload to another file. How do I go from tS3Put to tFileOutputDelimited?
OnSubjobOK after tSetGlobalVar_1 or tFileInputDelimited_2 should work.
I need this to happen after tS3Put, so I can get whether the upload completed or not.
It won't let me go from tS3put to tmap.
@TRF wrote:
In this case use OnComponentOK/OnComponentError after tS3Put
loop--> call a python script using tsystem (which generates a log file with value1 and value2) and an output file-->tFileInputDelimiter2 reads the log file-->tjavaRow stores value1 and value2 into global variables-->tS3put uploads the file to S3. That works so far.
Now, if the upload was sucessful (I can use onSubjectOK), I want to write value1, value2 and the message ("OK") to another text file.
Hope that clears it out.
Right.
So you can replace your tMap by a tFixedFlowInput component with the same schema expected for the output file.
Then you populate each field with the desired values issued from the 2 global variables + "OK" for the message field.
Bingo. That's what I was looking for. Thank you.