Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to capture stats and logs in Big data jobs in files.

I want to capture the stats and log in Big data job like we do in standard job.

I could not see stat and log option in big data job , is there any other way to capture the details ?

 

Thanks,

Manish

 

Labels (2)
1 Reply
Anonymous
Not applicable
Author

Hello,

Could you please take a look at this Spark History section TalendHelpCenter:Logging and checkpointing the activities of your Apache Spark Job to see if it is what you are looking for?

Best regards

Sabrina