Talend Spark jobs ignores context values passed

karivadhan — Fri, 15 Nov 2024 23:51:59 GMT

I am calling 2 spark jobs from one DI job and passing only 2 context values from parent job to child.

But , on runtime , Spark job ignores these context values passed from DI job.

It takes NULL instead.

Above this , the spark jobs also ignores certain inbuilt context variables as well.

Has anyone faced such issue ?

Any help would be appreciated.

Re: Talend Spark jobs ignores context values passed

BMichelle1628740752 — Thu, 12 Aug 2021 04:00:24 GMT

The tJava component is setting a new context value for your context variable, and prints that value to ensure that your value is getting picked up.