topic Re: tSystem component is not displaying complete logs on the console in Talend Studio

tSystem component is not displaying complete logs on the console

Anonymous — Sat, 16 Nov 2024 07:05:57 GMT

Hi,

I am executing a sqoop export command through shell script which will be called using tSystem component in the job. When I execute the script on the edge node using CLI, I get complete logs written to the log file. When the same script is executed through Talend job, only couple of lines of the logs are written to the log file. I have set the options of "Standard output" and "error output" to console. On the console also, I get only first few lines of the sript logs.

Talend version : 6.3.1

I have attached a screenshot of the job design and log output for reference. Please suggest if there is any alternate to collect the entire logs from the shell script.

Re: tSystem component is not displaying complete logs on the console

Anonymous — Fri, 07 Dec 2018 14:31:02 GMT

Added Talend execution logs

Talend_sqoop_export_20181206170131.txt

Re: tSystem component is not displaying complete logs on the console

Anonymous — Mon, 10 Dec 2018 06:56:44 GMT

Hi,

Could you please advise whether you are running the Talend jobs also from the same edge node? The Talend Big data jobs should be configured to execute from edge node.

If you are currently running the Talend job from different node, could you please change the target execution to edge node and verify the results?

Warm Regards,

Nikhil Thampi

Re: tSystem component is not displaying complete logs on the console

Anonymous — Mon, 10 Dec 2018 14:23:47 GMT

Hi Nikhil,

Yes, Talend jobs are being executed on the same edge node where the shell script is executed.

I just noticed that, Talend log file has only warning messages from the sqoop execution although job is set to "info" for the log4j option.

Re: tSystem component is not displaying complete logs on the console

Anonymous — Tue, 11 Dec 2018 02:34:38 GMT

Hi,

Could you please change the logging mode to Debug and try if you are looking for more detailed logs?

Warm Regards,

Nikhil Thampi

Re: tSystem component is not displaying complete logs on the console

Anonymous — Tue, 11 Dec 2018 15:08:52 GMT

Hi Nikhil,

I changed the log level to debug, still no change in the log file. Only warning messages are logged to the file.

Re: tSystem component is not displaying complete logs on the console

parasarora — Mon, 03 Aug 2020 23:46:19 GMT

Hi ,

Getting the same exact issue in Talend 7.2.1 too where Sqoop warn log is only showing up through tSystem component. Can you please provide a solution if its already been found out