topic Re: Big Data Batch Job (Spark): Error while Loading Data into Hive in Talend Studio

Big Data Batch Job (Spark): Error while Loading Data into Hive

RashmiBector — Sat, 16 Nov 2024 01:30:09 GMT

Job Name: Hive_test

Job Description: tHiveInput --> tHiveOutput (With tHiveConfiguration and tHDFSConfiguration)

Type of Job: Spark job

Error in Management Console: (Right click on the job à Publish to cloud):

ERROR | 2020-09-07T13:29:36.594+0200 |

org.talend.ipaas.rt.deployment-agent:2.8.1 | Task

5f55f2fa44b1a9343b2f5c12/2.4 failed unexpectedly.

org.talend.ipaas.rt.flow.controller.impl.FlowExecutionException: Step

11bbf349-3506-4a5f-922d-e0734723a0ff failed with code -1 and error Job

stopped with errors or unable to run. (check the task execution logs for the

error details)

org.talend.ipaas.rt.flow.controller.impl.JobControllerImpl.doRun(JobControllerImpl.java:98)

~[?:?]

org.talend.ipaas.rt.flow.controller.impl.AbstractControllerImpl.lambda$run$0(AbstractControllerImpl.java:106)

~[?:?]

java.lang.Thread.run(Thread.java:748) [?:?]

Caused by: java.lang.Exception: Job stopped with errors or unable to

run. (check the task execution logs for the error details)

... 3 more

Anonymous — Thu, 10 Sep 2020 09:30:12 GMT

Hello,

Are you able to execute your job successfully in studio or does this issue only repro when you execute it newly published on Cloud ( TMC )?

Best regards

Sabrina

RashmiBector — Thu, 10 Sep 2020 09:39:09 GMT

Hi Sabrina,

We cannot execute Big Data Batch Job in Talend Studio. The only way to execute it is Publish to Cloud-->then run from TMC

Anonymous — Fri, 11 Sep 2020 08:44:05 GMT

Hello,

What's error message are you getting? On which talend build version you got this issue?

Best regards

Sabrina