Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2018-02-07 09:53 AM

Get spark batch job log in file

Hi ,

 

Can anyone please advice how to get complete log that comes on console to a file in case of spark batch job?

Any help will be much appreciated.

 

Thanks

Labels (1)
Labels
173 Views
0 Likes
1 Reply
Anonymous
Not applicable
‎2018-02-08 03:52 AM
Author

Hi,

Could you please have a look at this KB article about:https://community.talend.com/t5/Migration-Configuration-and/Cannot-Get-Talend-Spark-Job-Execution-Lo... to see if Spark History can meet  your needs?

Here is online document about:TalendHelpCenter:Logging and checkpointing the activities of your Apache Spark Job.

Best regards

Sabrina

173 Views
0 Likes