printing a value inside a big data spark job

TomG1 — Sat, 16 Nov 2024 09:40:54 GMT

Hi,

I am running a spark job in hadoop cluster.

I have tRowgenerator and tJavarow and tfileoutputdelimited.

I want to pass all the rows to delimited file as well as print the values of all fields of each row in tJavarow.

I want to see the values which are printed in log of Spark application(job)

Is this possible in big data spark job using tJavarow.

I am not able to print.

PS: I know this is possible in standard jobs

Thanks

Re: printing a value inside a big data spark job

Anonymous — Fri, 09 Jun 2017 15:30:56 GMT

I replied to your other subject which is the same but a little more detailed. Let me know if that answer helps: